-- Logs begin at Thu 2022-09-22 16:26:18 UTC, end at Thu 2022-09-22 17:20:53 UTC. -- Sep 22 16:51:29.450167 dv-cinder-835384-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 16:51:29.457435 dv-cinder-835384-28-smb devstack@keystone.service[81520]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 16:51:29 2022] *** Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: nodename: dv-cinder-835384-28-smb Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: machine: x86_64 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: clock source: unix Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: pcre jit disabled Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: detected number of CPU cores: 4 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: current working directory: / Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: detected binary path: /usr/bin/uwsgi-core Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: your processes number limit is 47680 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: your memory page size is 4096 bytes Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: detected max file descriptor number: 2048 Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: lock engine: pthread robust mutexes Sep 22 16:51:29.461438 dv-cinder-835384-28-smb devstack@keystone.service[81520]: thunder lock: enabled Sep 22 16:51:29.462221 dv-cinder-835384-28-smb devstack@keystone.service[81520]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 16:51:29.462221 dv-cinder-835384-28-smb devstack@keystone.service[81520]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 16:51:29.500880 dv-cinder-835384-28-smb devstack@keystone.service[81520]: Python main interpreter initialized at 0x5578453689c0 Sep 22 16:51:29.500880 dv-cinder-835384-28-smb devstack@keystone.service[81520]: python threads support enabled Sep 22 16:51:29.500880 dv-cinder-835384-28-smb devstack@keystone.service[81520]: your server socket listen backlog is limited to 100 connections Sep 22 16:51:29.500880 dv-cinder-835384-28-smb devstack@keystone.service[81520]: your mercy for graceful operations on workers is 90 seconds Sep 22 16:51:29.501265 dv-cinder-835384-28-smb devstack@keystone.service[81520]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 16:51:29.501347 dv-cinder-835384-28-smb devstack@keystone.service[81520]: *** Operational MODE: preforking *** Sep 22 16:51:29.501565 dv-cinder-835384-28-smb devstack@keystone.service[81520]: *** uWSGI is running in multiple interpreter mode *** Sep 22 16:51:29.501565 dv-cinder-835384-28-smb devstack@keystone.service[81520]: spawned uWSGI master process (pid: 81520) Sep 22 16:51:29.501766 dv-cinder-835384-28-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 16:51:29.504162 dv-cinder-835384-28-smb devstack@keystone.service[81520]: spawned uWSGI worker 1 (pid: 81529, cores: 1) Sep 22 16:51:29.504162 dv-cinder-835384-28-smb devstack@keystone.service[81520]: spawned uWSGI worker 2 (pid: 81530, cores: 1) Sep 22 16:51:29.504408 dv-cinder-835384-28-smb devstack@keystone.service[81520]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 16:51:33.787122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:51:33.787122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: from cryptography.utils import int_from_bytes Sep 22 16:51:33.787929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:51:33.787929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: from cryptography.utils import int_from_bytes Sep 22 16:51:33.788054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:51:33.788054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: from cryptography.utils import int_from_bytes Sep 22 16:51:33.788054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:51:33.788054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: from cryptography.utils import int_from_bytes Sep 22 16:51:33.838016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 16:51:33.838173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 16:51:33.838268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 16:51:33.838350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 16:51:33.838412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] command line args: [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 16:51:33.838475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] command line args: [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 16:51:33.838635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 16:51:33.838767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 16:51:33.838846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ================================================================================ {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 16:51:33.838924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ================================================================================ {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 16:51:33.839081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] admin_token = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] admin_token = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] config_dir = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] config_dir = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] config_source = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] config_source = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] debug = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.839953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] debug = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.840921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_config_append = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_config_append = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.841904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_dir = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_dir = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_file = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_file = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.842994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.843940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.844959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.845956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] publish_errors = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] publish_errors = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.846934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] standard_threads = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] standard_threads = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.847954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] use_journal = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] use_journal = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] use_json = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] use_json = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] use_stderr = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] use_stderr = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] use_syslog = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] use_syslog = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.848976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.849063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:51:33.849239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.849961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.850961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.851937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.852917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.853991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.854921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.855943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.856893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.857850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.858982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.859988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.860920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.861864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.862994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.863999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.864917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.865891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.866892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.867997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.868953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.869972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.870974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.871924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.872976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.873992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.external = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.874995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.external = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.875966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.password = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] auth.token = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.password = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] auth.token = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.876887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.877990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.878992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.879784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.880494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.880588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.880737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.880825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.880988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.881844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.882839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.883963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.884933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.885978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.886940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.887890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.888997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.889993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.890954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.891978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.892945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.893883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.894843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.895567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.896369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.896598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.896870 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.896950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.897949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.898928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.899899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.900864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.901947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.902936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.903968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.904997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.905914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.906989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.907905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.908959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.909969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.910975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] role.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] role.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] role.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] role.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.911971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.912769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.913924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.914980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.915967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.916988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.917876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.918941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.919999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.920905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.921921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.922947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.923852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.924883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.connection = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.connection = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.925892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.926939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.927873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.928940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 16:51:33.929842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:51:33.929842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81529) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 16:51:33.955998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.956215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.956443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.956827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.957061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.957288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.965361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.966383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.993752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.993989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.994418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:33.994663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.048479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.048903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.097167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.097404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.097524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.097763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.253962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.254912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.255001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.255132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.255270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.255675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.255916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.279937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.280058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.280143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.280269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.280352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.280483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.292158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.292484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.305435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.305654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.305741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.305884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.305984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.306901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.307038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.307173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.307173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81529) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 16:51:34.323740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.323953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 16:51:34.324097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.324260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 16:51:34.324390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.324536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 16:51:34.324669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.324802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.324934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 16:51:34.325066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.325874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.335610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.335891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.336942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.343367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.343840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.346250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.346540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.346713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.346845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.347972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.348105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.348234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.348361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.348495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.348680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.349342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.349604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.349735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.350091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.350368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.372108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.373208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.373579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.373878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.374683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.374984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.378600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.378913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.379202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.379682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.380092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.380473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.385775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.386067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.386896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.387184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.391683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.391985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.392276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.392564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.392741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.392881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.393871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.394147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.394420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.394711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.409661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.409944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.410967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.411854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.414502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.415881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.417685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.417987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.419050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.419348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.422117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.423451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.425191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.426466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.428382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.428686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.428977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.429267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.429549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.429835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.429974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.430223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.430508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.430818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.431100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.431378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.445237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.445530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.445804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.446073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.447152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.447443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.447712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.447977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.452829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.454333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.454660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.455862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.456144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.456274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.457634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.457909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.459365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.459654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.459948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.460234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.460630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.461513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.461869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.462159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.462443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.462849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.471712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.472001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.472285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.472570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.472952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.473244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.473525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.473942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.474437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.474767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.475057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.475437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.475726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.476006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.488995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.491511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.491959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.494367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.494859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.496309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.497232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.497766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.498051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.498454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.498702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.500156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.500439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.500842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.505320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.506806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.507957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.509410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.509682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.510079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.510369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.510672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.512292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.512690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.512980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.513256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.518393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.518714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.520933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.521246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.521561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.521861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.528050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.528340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.528624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.528906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81529) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 16:51:34.529167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.529977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.530982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.531882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.532173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.532441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81529) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 16:51:34.565893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578453689c0 pid: 81530 (default app) Sep 22 16:51:34.567128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578453689c0 pid: 81529 (default app) Sep 22 16:51:34.569777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ddf3-4ac2-46b1-b4d3-98071ec0e1bf None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:34.570065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ddf3-4ac2-46b1-b4d3-98071ec0e1bf None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:34.570340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ddf3-4ac2-46b1-b4d3-98071ec0e1bf None None] PATH_INFO: `/v3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:34.574551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Thu Sep 22 16:51:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:41.427464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:41.427974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:41.428090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:41.432315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:51:41.437637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:41.438042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:41.438204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:41.509258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: INFO dbcounter [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] Registered counter for database keystone Sep 22 16:51:41.528363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG oslo_db.sqlalchemy.engines [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:51:41.534618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writer thread running {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:51:41.721682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG passlib.handlers.bcrypt [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81530) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 16:51:41.721980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG passlib.handlers.bcrypt [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81530) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 16:51:41.780011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:41.781625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:41.908317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 16:51:42.359459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:42.428958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: INFO dbcounter [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] Registered counter for database keystone Sep 22 16:51:42.450508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG oslo_db.sqlalchemy.engines [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81529) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:51:42.456657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writer thread running {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:51:42.578815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046daf79-b51e-47e8-bbf6-2d1678c6b7e5 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:42.584611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:42.585249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:42.585536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:42.585811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:42.594066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:42.647712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 16:51:42.648064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae916a5-5ca4-4146-9ca8-66688b271249 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:42.657676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Sep 22 16:51:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 16:51:42.664263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:42.681148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e3b2-006c-4d6f-a047-a7d0d3625d43 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:42.685541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:42.686649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:42.686965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:42.687243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] PATH_INFO: `/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:42.688833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] RBAC: Authorizing `identity:get_project(project_id=fea30cfd8ebb4269b38aaa42ab5d2d7a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:42.742661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 16:51:42.743030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a28f2-d7b0-4441-aa1f-72ebf0b85ec8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:42.747543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Thu Sep 22 16:51:42 2022] GET /identity/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:44.877894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde370-c5cc-44ed-81fc-5c7e7f149405 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:44.878453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde370-c5cc-44ed-81fc-5c7e7f149405 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:44.878453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bde370-c5cc-44ed-81fc-5c7e7f149405 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:44.883325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:51:44.888775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:44.889142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:44.889317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:44.909340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:44.911322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:44.918997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 16:51:45.187516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde370-c5cc-44ed-81fc-5c7e7f149405 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:45.200087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bde370-c5cc-44ed-81fc-5c7e7f149405 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:45.204268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:45.204871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:45.205156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:45.205430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:45.213610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:45.215424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b46818-c4a9-4c64-ad29-66419a7c45cd admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:45.224109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Sep 22 16:51:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 16:51:45.229416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:45.238739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9875423-b207-4d88-8e32-66eca698bae4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:45.243025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:45.243653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:45.243936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:45.244209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:45.245488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:45.247337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7bad-ca7c-4988-b9bc-d85f386159a8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:45.248849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Thu Sep 22 16:51:45 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:47.456912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e6ec-cb7a-4790-9f64-907b9c288329 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:47.457455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e6ec-cb7a-4790-9f64-907b9c288329 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:47.457455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e6ec-cb7a-4790-9f64-907b9c288329 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:47.458876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:47.464164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:47.464573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:47.464720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:47.483367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:47.484548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:47.512676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166290e-59cf-4272-9f4c-ff4dce627e71 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:47.512961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166290e-59cf-4272-9f4c-ff4dce627e71 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:47.513230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166290e-59cf-4272-9f4c-ff4dce627e71 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:47.514534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:51:47.520643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:47.521188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:47.521474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:47.562979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG passlib.handlers.bcrypt [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81529) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 16:51:47.563378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG passlib.handlers.bcrypt [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81529) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 16:51:47.568113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:47.614336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:47.615946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:47.721915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:51:47.836547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:47.860020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:47.940095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01517a52-6c87-44d5-ad17-755c38b56ad8 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:47.973361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:47.973933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:47.974668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:47.974957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:47.987338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:51:47.990006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:51:47.996817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:51:47.997845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:51:47.998926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:51:48.003772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.085235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.091639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070176d-4dcf-4e37-bb90-ec44507805ba None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.093925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.103665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f6127-b7aa-4ee1-8a10-a0e9c7dff554 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.132130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.132984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.133271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.133541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.137853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.138516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.138838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.139119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.139819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:48.140130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.141533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.154077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:48.160299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.201695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.203261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.259574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c79a7-f028-49cc-9afa-7ffe4b8e88c0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.293063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.293692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.293978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.294261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.295434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.296893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.298696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 9/16] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:48.303585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 8/17] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:51:48.304387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.307390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.310125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.319421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.404212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a6f06-cc45-4eeb-a59d-cc8cf4f26685 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.407204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caa2b9-9530-49e8-879b-2ef69fe1a68d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.438811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.439445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.439732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.440016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.441289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.441519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.442376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.442673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.442781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.442964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.444301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:48.449970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.462516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.464023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:51:48.483152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:51:48.484247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:51:48.485294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:51:48.485294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:51:48.485294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:51:48.485294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:51:48.491617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:48.530350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.548374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:48.550288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9611f0-bc8a-4d17-a4b0-aacafdeea737 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.584549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.585166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.585452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.585728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.586461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.domain.id=default, user.id=6b441038ebcb444080c635316cb2b19a) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:48.586808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.588302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb91c4-d315-4c41-a683-af696acd634f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.594816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/role_assignments?user.id=6b441038ebcb444080c635316cb2b19a&scope.domain.id=default&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:48.597011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a452-b312-4816-970b-e66672c20137 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:48.637494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:48.638119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:48.638401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:48.638739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:48.639396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:48.639737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:48.641152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573c4bf-dda9-4981-8117-5958bd610bda None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:48.662783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:50.944513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4831d0-96ce-411c-b90f-b5ecdbedc45c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:50.945604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4831d0-96ce-411c-b90f-b5ecdbedc45c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:50.946090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4831d0-96ce-411c-b90f-b5ecdbedc45c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:50.947671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:50.953706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:50.954693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:50.955230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:50.976329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:50.977864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:51.052131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:51.333401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4831d0-96ce-411c-b90f-b5ecdbedc45c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:51.476348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4831d0-96ce-411c-b90f-b5ecdbedc45c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:51.520047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:51.520953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.521240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.521516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.543623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-5e96ab80-9d12-40f9-9a20-8223ca70b563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:51:51.548964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:51:51.550560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:51:51.551365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 13/24] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:51:51.558214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:51.608784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96be3c-60b0-4c56-9954-62cb0a6e814b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.608979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96be3c-60b0-4c56-9954-62cb0a6e814b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.609328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96be3c-60b0-4c56-9954-62cb0a6e814b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.610565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 14/25] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:51.628729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eef2-7877-4345-8dc6-46fdbfae2330 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.629017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eef2-7877-4345-8dc6-46fdbfae2330 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.629225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0eef2-7877-4345-8dc6-46fdbfae2330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.637638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:51.654494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:51.672537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8df0eef2-7877-4345-8dc6-46fdbfae2330 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:51.673776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8df0eef2-7877-4345-8dc6-46fdbfae2330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:51.742645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7687a-28e8-477f-84b4-58e3864aa309 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:51.788512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:51.789141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.789423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.789693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.790355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:51.790688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:51.792056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d72d7-078a-416d-8265-1aad0250e99c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:51.810900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 12/26] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:51.812138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab57a-4b22-4f71-86ea-8691702dd0a9 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.812395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab57a-4b22-4f71-86ea-8691702dd0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.812669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab57a-4b22-4f71-86ea-8691702dd0a9 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.813857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:51.818349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 15/28] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 22 16:51:51.819927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfe7d8-9cae-4013-8cd3-030d05a5dc98 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:51.820214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfe7d8-9cae-4013-8cd3-030d05a5dc98 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:51.820485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfe7d8-9cae-4013-8cd3-030d05a5dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:51.827446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab57a-4b22-4f71-86ea-8691702dd0a9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:51.860827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e3cfe7d8-9cae-4013-8cd3-030d05a5dc98 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:51.861985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e3cfe7d8-9cae-4013-8cd3-030d05a5dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:52.006967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 16/29] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:51:52.019173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab57a-4b22-4f71-86ea-8691702dd0a9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.028974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.050615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd8d4-f99e-4f3f-b129-54191d3dc548 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.050983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd8d4-f99e-4f3f-b129-54191d3dc548 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.051194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd8d4-f99e-4f3f-b129-54191d3dc548 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.052787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 17/30] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:52.057852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.058137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.058411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.074043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:52.074760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.075045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.075318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.078130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:52.079847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:52.083441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 14/31] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:51:51 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:52.085681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:52.086952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:52.089715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.234645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.248533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 18/32] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:52.249356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.313435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d61699-8fce-4611-adee-b523d1fa3ce2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.372091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:52.372740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.373022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.373300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.374425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:52.375916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:52.377729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 15/33] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:52.378272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.436114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a457ec-b851-4f25-9063-fd7c6f9abe59 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.469602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.475676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:52.476444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.476827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.477203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.489282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:52.490847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:51:52.508054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:51:52.509123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:51:52.510133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:51:52.510133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:51:52.510133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:51:52.511598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 19/34] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:51:52.512579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.564843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.587974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf3f89-8b1c-4f80-81da-a134693fed37 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.627138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336ca6-8556-4284-b4d8-5be255cf8eb2 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.631291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:52.632148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.632606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.633053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.633899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:52.635499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:52.670437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:52.671156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:52.671449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:52.671729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] PATH_INFO: `/v3/domains/default/users/6b441038ebcb444080c635316cb2b19a/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:52.673720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6b441038ebcb444080c635316cb2b19a, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:52.676262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:52.769429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 16/35] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 22 16:51:52 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:51:52.770993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.799739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 20/36] 10.222.0.50 () {58 vars in 1361 bytes} [Thu Sep 22 16:51:52 2022] PUT /identity/v3/domains/default/users/6b441038ebcb444080c635316cb2b19a/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:51:52.801467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:52.902702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305b264-1504-4b4c-b228-1f5832ddf0d2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.907394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.920010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a804-a6c7-4464-b9a5-6c9748f5e5f6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:52.935992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:52.999486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:53.000139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.000423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.000703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.001386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:53.001697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:53.004855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a16cb-e0a6-4375-9593-1a21479dbd27 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:53.019562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:53.020189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.020661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.020943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.021647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:53.026705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a14d-4a82-43ff-a40c-73c9a59a9b31 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:53.040806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 17/37] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:53.042769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fa0f-b2f9-4bc1-b40f-3ddc4fd46580 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.043062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fa0f-b2f9-4bc1-b40f-3ddc4fd46580 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.043339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65fa0f-b2f9-4bc1-b40f-3ddc4fd46580 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.045387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 18/38] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:53.047054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65fa0f-b2f9-4bc1-b40f-3ddc4fd46580 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:53.069560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 21/39] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 22 16:51:52 2022] POST /identity/v3/roles => generated 225 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:51:53.072080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f94c8-fccb-4e05-ad76-5752b076b639 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.072533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f94c8-fccb-4e05-ad76-5752b076b639 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.072957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f94c8-fccb-4e05-ad76-5752b076b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.105333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-753f94c8-fccb-4e05-ad76-5752b076b639 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:53.107680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-753f94c8-fccb-4e05-ad76-5752b076b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:53.190413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65fa0f-b2f9-4bc1-b40f-3ddc4fd46580 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:53.215392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 22/40] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:53.235695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:53.236349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.236896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.237110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.237870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:53.239605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1bc094-7261-497b-a67e-8df0ba936104 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:53.278782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 19/41] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:51:53 2022] POST /identity/v3/projects => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:51:53.409072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb471c-3d0d-4f41-b3a1-cd363ac0e3a3 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.410111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb471c-3d0d-4f41-b3a1-cd363ac0e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.410598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb471c-3d0d-4f41-b3a1-cd363ac0e3a3 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.412427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 23/42] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:53.418394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.418710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.421681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.443348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:53.444956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:53.457720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:53.528511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 20/43] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:53.529779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb471c-3d0d-4f41-b3a1-cd363ac0e3a3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:53.744823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:53.753980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb471c-3d0d-4f41-b3a1-cd363ac0e3a3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:53.790045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:53.790578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.790888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.791167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.791860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:53.793242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:53.801314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:53.810720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 24/44] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 22 16:51:53 2022] POST /identity/v3/roles => generated 223 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:51:53.914455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9acf4d-f725-40b4-be3a-ef6ee99e260c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:53.950678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:53.951339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:53.951626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:53.951903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:53.953039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:53.954547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a340f21-18f4-4046-914c-7130eb2515d6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:53.957117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 21/45] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:53.962765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:54.073379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5600c43-0784-4ade-a542-fa21b644d32d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:54.105902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:54.106524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:54.106851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:54.107128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:54.107792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:54.109279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ed4f-6c5c-4164-afbc-96c21d1f06d9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:54.138035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 25/46] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:51:53 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 16:51:55.259909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3184c-31f3-421c-a4bf-a654fbbd8301 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:55.260396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3184c-31f3-421c-a4bf-a654fbbd8301 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:55.260505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3184c-31f3-421c-a4bf-a654fbbd8301 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:55.261798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 22/47] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:55.267121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:55.267536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:55.267777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:55.285941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:55.287176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:55.289171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:55.354098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 26/48] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:55.620896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3184c-31f3-421c-a4bf-a654fbbd8301 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:55.637004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:55.725124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3184c-31f3-421c-a4bf-a654fbbd8301 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:55.758915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:55.759546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:55.759831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:55.760105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:55.772119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:51:55.778803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:51:55.779664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:51:55.780441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 23/49] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:51:55.787061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:55.893343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b1014-3e9c-47ee-82d9-8e941cb46547 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:55.926621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:55.927257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:55.927544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:55.927820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:55.928493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:55.928805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:55.930207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:55.935427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:55.939365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 27/50] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:55.945185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:56.021624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:56.047770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856839fc-60a1-4e63-8c6d-d5ce162a5718 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:56.082930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:56.083563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.083843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.084114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.085229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:56.086735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:56.088303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 24/51] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:51:55 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:56.093813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:56.197249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efe5aa-1705-4caf-b484-343adbe154f6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:56.231586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:56.232224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.232508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.232786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.233890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:56.235411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840140-bdcd-46b5-809e-1092f7b3278a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:56.237573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 28/52] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:56.243379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:56.297042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24043-9def-43ba-8fa3-638323f2e737 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.297551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24043-9def-43ba-8fa3-638323f2e737 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.297638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24043-9def-43ba-8fa3-638323f2e737 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.298974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 29/53] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:51:56.304624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80924-626a-4345-ad09-66132e11209d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.304918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80924-626a-4345-ad09-66132e11209d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.305196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe80924-626a-4345-ad09-66132e11209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.323858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bfe80924-626a-4345-ad09-66132e11209d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:56.325069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bfe80924-626a-4345-ad09-66132e11209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:56.343058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1b03-2919-44e7-874c-67dd3e93ef16 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:56.376575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:56.377192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.377611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.377898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.378625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.domain.id=default, user.id=6b441038ebcb444080c635316cb2b19a) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:51:56.378969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:56.380426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:56.386779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:56.389691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 25/54] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Sep 22 16:51:56 2022] GET /identity/v3/role_assignments?user.id=6b441038ebcb444080c635316cb2b19a&scope.domain.id=default&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:51:56.392740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 30/55] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:51:56.668503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:56.677523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:56.871894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35a698-b9f5-4bd2-bfde-b11396a30f50 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:56.905368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:56.905989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:56.906275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:56.906552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:56.907680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:56.909810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154af4f-4bf5-4c7b-830a-0cb3c5e4d430 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:56.911448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 26/56] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:56.917023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80924-626a-4345-ad09-66132e11209d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:57.014203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe80924-626a-4345-ad09-66132e11209d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:57.047388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:57.047994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:57.048279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:57.048556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:57.049224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:57.050698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9d2c-824c-42f1-90ff-b9220c5c497c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:57.076872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 31/57] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Sep 22 16:51:56 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:51:59.210327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c28c4-2132-40fc-83a0-50131c07ca63 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:59.210862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c28c4-2132-40fc-83a0-50131c07ca63 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:59.210969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c28c4-2132-40fc-83a0-50131c07ca63 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:59.212241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 27/58] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:51:59.217326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:59.217689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:59.217894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:59.236475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:51:59.237698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:51:59.282304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:59.303885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 32/59] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:51:59.573036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c28c4-2132-40fc-83a0-50131c07ca63 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:59.649590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:51:59.677664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c28c4-2132-40fc-83a0-50131c07ca63 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:59.714565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:59.715211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:59.715496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:59.715768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:59.716859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:59.718289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30392ec-5ba9-40e7-a8f1-fcc85a8a1569 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:59.719855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 28/60] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:51:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:51:59.725465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:51:59.827888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdd3c4-2728-473d-9356-b9312f791ebe None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:51:59.861624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:51:59.862330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:51:59.862621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:51:59.862923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:51:59.863582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:51:59.865019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03166-81bd-4b82-a328-7a0c2dd6f012 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:51:59.890268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 33/61] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:51:59 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:03.308659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6bbe-e5aa-4503-aa2c-a0fc54f72e7e None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.309489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6bbe-e5aa-4503-aa2c-a0fc54f72e7e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.309937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a6bbe-e5aa-4503-aa2c-a0fc54f72e7e None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.311551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 29/62] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:03.313230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7ecf1-f514-4f22-95db-491de7b0f32c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.314059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7ecf1-f514-4f22-95db-491de7b0f32c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.314484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7ecf1-f514-4f22-95db-491de7b0f32c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.318488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f28e-02c2-4836-98be-1d16decdedb4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.318817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f28e-02c2-4836-98be-1d16decdedb4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.319100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1f28e-02c2-4836-98be-1d16decdedb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.321724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 34/63] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:03.323344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de28d9-c766-4a1b-bc31-999b7a2656ee None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.323811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de28d9-c766-4a1b-bc31-999b7a2656ee None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.324269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de28d9-c766-4a1b-bc31-999b7a2656ee None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.325728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 35/64] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:03.330703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dece-0af0-4821-9ae4-1cac3c634460 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.331202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dece-0af0-4821-9ae4-1cac3c634460 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.331747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9dece-0af0-4821-9ae4-1cac3c634460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.342493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-90d1f28e-02c2-4836-98be-1d16decdedb4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:03.343770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-90d1f28e-02c2-4836-98be-1d16decdedb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:03.350477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-49c9dece-0af0-4821-9ae4-1cac3c634460 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:03.351948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-49c9dece-0af0-4821-9ae4-1cac3c634460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:03.382926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:03.426037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 36/65] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:03.427568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb22c-8340-4822-89f8-b456a7b5f3c5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.428002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb22c-8340-4822-89f8-b456a7b5f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.428450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bb22c-8340-4822-89f8-b456a7b5f3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.431199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 30/66] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:03.447111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1f0bb22c-8340-4822-89f8-b456a7b5f3c5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:03.448500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1f0bb22c-8340-4822-89f8-b456a7b5f3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:03.520983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 37/67] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:03.703847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf8aa-2c25-4480-a710-0b7d837a2b3a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.704136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf8aa-2c25-4480-a710-0b7d837a2b3a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.704417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf8aa-2c25-4480-a710-0b7d837a2b3a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.705995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 31/68] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:03.711453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:03.711747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:03.712029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:03.734444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:03.735678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:03.822334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 38/69] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:03.842310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdf8aa-2c25-4480-a710-0b7d837a2b3a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:03.873647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:03.906746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:03.952625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:03.997214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a4e35-2957-4239-bdc8-e0954b0f80f3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:03.999668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdf8aa-2c25-4480-a710-0b7d837a2b3a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.036668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.037582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.038011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.038440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.044855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.045747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.046032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.046694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.049189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:04.054849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:04.055725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:04.056966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 39/70] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:04.057634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.062358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6ff86461-d018-44b1-bfb0-828a5478db54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:04.067330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:04.068204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:04.068973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 32/71] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:04.069792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9252-ca5e-45e5-bd57-4192fc418d5f None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.070154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9252-ca5e-45e5-bd57-4192fc418d5f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.070447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9252-ca5e-45e5-bd57-4192fc418d5f None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.071867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 33/72] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:04.076111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9252-ca5e-45e5-bd57-4192fc418d5f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.153472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.169945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5b7fb-2e4d-44d8-9282-ca3915b9723c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.192297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9252-ca5e-45e5-bd57-4192fc418d5f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.204229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.204874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.205161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.205445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.216727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:04.221178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:04.221534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:04.223041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:04.223972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 40/73] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:04.224711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.227750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.228554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.229041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.229492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.230180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:04.230707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.232114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6966e4a-60d3-4169-8a93-258f76a61099 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.241426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 34/74] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.242719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.243018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.243301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.261684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:04.262910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:04.326708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572936-eafc-475a-a54c-89bcb2efc849 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.330507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 35/75] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:04.331435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.365445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.366051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.366330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.366613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.367311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:04.367622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.369013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.377115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 41/76] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.377741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.390159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.445759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225cb40-589d-4622-8c0e-696ab4e1b3f7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.470250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.481180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.481823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.482107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.482463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.490605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accf591-7949-43c0-9bdc-ad3c4a6547c8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.493480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:04.498519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:04.499527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 36/77] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:04.504171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.531358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.531976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.532263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.532544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.533269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:04.533631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.535599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.543765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 42/78] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.549130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.609122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ea20-26e4-431d-9def-395bf4fd9a16 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.620785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.644003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.645179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.645523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.645804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.647251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.648738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.650467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 37/79] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.651179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.657718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf406c56-30f7-405c-a411-11e92c12096f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.690746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.691893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.692181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.692463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.702948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.705702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.707906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.709562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 43/80] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.710332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.753126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520069-41e1-429a-acbc-2a4c3de80148 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.788982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.789596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.789884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.790161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.790859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:04.791173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.792552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.800497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 38/81] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.800497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.814526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f836bb-a1f6-45aa-8c11-2d253e95ba0c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.840747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.849458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.850094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.850379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.850679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.851802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.853247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.854859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 44/82] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.855622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.901924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc19070-1b05-43ac-ac7b-97288d1bb5fa None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.915295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:04.936496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.937144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.937431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.937711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:04.938862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:04.940324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:04.941966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 39/83] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:04.943475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:04.953835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eca10-74fc-42e8-b892-5d489b7ca00e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:04.993676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:04.994293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:04.994579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:04.994900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.045647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f7d7-20f0-4f4a-bf35-3d28fd262483 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.057226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.064348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.066414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.079626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.080246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.080535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.080818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.129524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.148638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.150110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.165892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 45/84] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:05.166769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.250172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 40/85] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:05.251058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.259350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.265604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4883a-8e3e-4d36-80d6-03c3d5b4e7f1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.300097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.301196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.301486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.301764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.302936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.304396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.305976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 46/86] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:05.306752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.333655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.352088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e536dd8-f5d2-47b4-bcdd-2465bc0ff5f5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.385197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.385814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.386102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.386380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.407262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c79a2d-a5ef-4516-9c76-6223750d9254 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.444416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.445030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.445319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.445598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.446247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.447728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.453099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.454541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.469027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 47/87] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:05 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:05.470029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.494766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.549583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.573142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 41/88] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:05.574221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.591489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd238f-4cf9-41a0-8b86-144be5f88f0e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.633050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.633711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.633994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.634273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.635462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.636978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.638644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 48/89] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:05.645604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.696049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407690b6-2a87-4aa7-9ae5-a5b0f5d623bc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.734947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.735855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.736287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.736708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.738529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.740197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.741936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 42/90] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:05.743025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:05.763018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.780108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3db5-2e40-4681-96f0-d39fb7a94a8c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.806848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:05.824126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.824677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.824963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.825432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.866604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0337a4e-e4ec-493a-a7c4-ed954a6cca72 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:05.914530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.915733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:05.916385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:05.916672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:05.916953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:05.917296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.918161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:05.920006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:05.922922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 43/91] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:05.923622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:06.021944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:06.037411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 49/92] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:06.038501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:06.060763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229e54b-ea57-4848-8a85-ca2dbb6e669f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:06.080146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:06.099002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:06.099617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:06.099900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:06.100176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:06.101058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=6b441038ebcb444080c635316cb2b19a) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:06.101370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:06.102835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:06.108913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 44/93] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:05 2022] GET /identity/v3/role_assignments?user.id=6b441038ebcb444080c635316cb2b19a&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:06.109707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:06.156689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591ec74-c181-4490-83c2-3c5030d50851 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:06.196681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:06.197349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:06.197716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:06.198048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:06.199014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:06.199330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:06.200970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:06.207700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 50/94] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:06 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=1197acedde154542b162281404f9b02c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:06.215053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:06.257412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972327f-fac3-4165-a615-1e6b44644d4b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:06.297295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:06.297938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:06.298221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:06.298494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:06.299310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:06.299623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:06.301269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:06.308012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 45/95] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:06 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:06.348214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:06.420407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb47a5-d330-4881-955d-a8e3cc83e3a6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:06.462236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:06.462950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:06.463240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:06.463525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] PATH_INFO: `/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:06.464744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] RBAC: Authorizing `identity:get_project(project_id=b5419a4bd6134e65b4a6c630c5adcef9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:06.466281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d4c96-d11e-4986-8b7d-ebe9b9539572 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:06.468461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 51/96] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:06 2022] GET /identity/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9 => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:06.475822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:06.546001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:06.616414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c0ff-cf82-4ce0-b388-2686115c8d70 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:06.654084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:06.654725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:06.655018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:06.655297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:06.656040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=b5419a4bd6134e65b4a6c630c5adcef9, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:06.656353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:06.657808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc099fa7-3d25-4d62-bfab-714dce7b62de None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:06.665326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 46/97] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:06 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=b5419a4bd6134e65b4a6c630c5adcef9&role.id=1197acedde154542b162281404f9b02c => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:08.181621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ec83-5d6d-42a2-85be-a3f606174030 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:08.182131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ec83-5d6d-42a2-85be-a3f606174030 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:08.182463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872ec83-5d6d-42a2-85be-a3f606174030 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:08.184142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 52/98] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:08.189484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:08.189934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:08.190231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:08.210033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:08.211254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:08.281243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 47/99] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:08.635322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872ec83-5d6d-42a2-85be-a3f606174030 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:08.778872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872ec83-5d6d-42a2-85be-a3f606174030 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:08.806732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:08.827409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:08.828049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:08.828332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:08.828607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:08.841578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:08.846397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:08.847330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:08.848541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 53/100] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:08.853691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:08.909420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:08.977963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c5ba7-aeff-4b23-bb04-7a49d2d69e77 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:09.016538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:09.017468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.017923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.018368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.019234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:09.020294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:09.022083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:09.031547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 48/101] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:09.037660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:09.190923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7dd4e-9916-45b5-a56b-72044e1bd6d4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:09.245203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:09.245874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.246159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.246438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] PATH_INFO: `/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.268454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] RBAC: Authorizing `identity:get_user(user_id=5f13b112f8414a3fba9e14a30e3cb9dc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:09.270942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4f9ea-f58c-408d-990f-cf16e45aff6c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:09.273128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 54/102] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:09 2022] GET /identity/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:09.278847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:09.357946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdda5-3688-4b37-afd1-6ae1e63e7087 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.358577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdda5-3688-4b37-afd1-6ae1e63e7087 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.359173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdda5-3688-4b37-afd1-6ae1e63e7087 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.360840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 55/103] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:52:09.367168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408522-42b7-43e6-b16e-cd7df9c73c7f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.367720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408522-42b7-43e6-b16e-cd7df9c73c7f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.368208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408522-42b7-43e6-b16e-cd7df9c73c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.398209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6feeef-20b7-4000-ab0c-751e40ecae92 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:09.399331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-57408522-42b7-43e6-b16e-cd7df9c73c7f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:09.400296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:09.401868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-57408522-42b7-43e6-b16e-cd7df9c73c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:09.436961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:09.437830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.438281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.438726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.455166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:09.518799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:09.522537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5cbba-2601-4772-8af7-831e202cefc0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:09.526036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 56/104] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:09.527507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443370-f717-4aae-b41e-d718fb77b11d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.527935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443370-f717-4aae-b41e-d718fb77b11d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.528347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443370-f717-4aae-b41e-d718fb77b11d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.535140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 57/105] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:09.540363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2452e8-c446-42dd-ad8d-4dc4053f3776 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.540840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2452e8-c446-42dd-ad8d-4dc4053f3776 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.541258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2452e8-c446-42dd-ad8d-4dc4053f3776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.567199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7d2452e8-c446-42dd-ad8d-4dc4053f3776 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:09.569667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7d2452e8-c446-42dd-ad8d-4dc4053f3776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:09.689482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 58/106] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:09.691244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c756e-134f-49ed-a005-ba9bbdc413fc None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.691953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c756e-134f-49ed-a005-ba9bbdc413fc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.692630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c756e-134f-49ed-a005-ba9bbdc413fc None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.694280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 49/107] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:09.694580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 59/108] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:09.699309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c274e9-866b-4eba-8c90-6a3e52ad4009 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.699794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c274e9-866b-4eba-8c90-6a3e52ad4009 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.700212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c274e9-866b-4eba-8c90-6a3e52ad4009 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.700439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb365-65b4-4552-8759-981cf950e7be None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.700825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb365-65b4-4552-8759-981cf950e7be None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.701217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb365-65b4-4552-8759-981cf950e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.702371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 50/109] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:09.703232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c274e9-866b-4eba-8c90-6a3e52ad4009 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:09.706205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:09.731393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6acbb365-65b4-4552-8759-981cf950e7be None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:09.732902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6acbb365-65b4-4552-8759-981cf950e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:09.844985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c274e9-866b-4eba-8c90-6a3e52ad4009 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:09.851859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 60/110] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:09.853776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.854142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.854508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.876975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:09.878251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:09.885910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:09.886711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:09.887072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:09.887465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:09.888676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:09.890371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:09.892807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 51/111] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:09 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:09.893564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:09.949519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:09.982945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.016043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179d6b-bddb-4f82-a0a9-826376125d19 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.053277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.053921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.054208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.054489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.061438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 61/112] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:10.062367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.079447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:10.085396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:10.086397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:10.087221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 52/113] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:10.091439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.221648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c428c40-f592-429a-9aff-26f4609c8011 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.275630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.276185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.276721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.277011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.277759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=5f13b112f8414a3fba9e14a30e3cb9dc) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:10.278075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.280543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.282587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea7c-2ff8-44b7-a2ca-d83c9bf92bc2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.290698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 62/114] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/role_assignments?user.id=5f13b112f8414a3fba9e14a30e3cb9dc&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:10.290698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.340081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.342052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.347105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.347900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.348285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.349014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.349804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.351333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.353006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 53/115] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:10.353789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.433649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2278244-8606-416b-a48e-d22e2fd2cb4c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.465940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0efb3-c7d8-4dc4-abe7-2bc8f871721f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.471976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.472609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.473633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.473930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.474621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:10.474980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.476532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.486448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 63/116] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:10.487233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.509850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.510478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.510993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.511096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.521650 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:10.526837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:10.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:10.528473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 54/117] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:10.529143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.587092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.600168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.605284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2cf7-c2d8-45c4-b48d-332f382302f4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.640751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.641641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.641926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.642270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.651658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659edc43-3e1a-4450-860c-57e083d24e80 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.654087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b28cbbab-aae5-4095-8676-a90e6bab40fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:10.659393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:10.660324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:10.661535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 64/118] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:10.662177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24205-f654-4e9b-9f3d-a629cb3f0a0a None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.662177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24205-f654-4e9b-9f3d-a629cb3f0a0a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.662380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e24205-f654-4e9b-9f3d-a629cb3f0a0a None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.663648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 65/119] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:10.664358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e24205-f654-4e9b-9f3d-a629cb3f0a0a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.700725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.701733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.702269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.702704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.703798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.706175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.735686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 55/120] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:52:10 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:10.747787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.783912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e24205-f654-4e9b-9f3d-a629cb3f0a0a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.837351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.838425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.838754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.839044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.840588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.843006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.845528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 66/121] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:10.846900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:10.870154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.901955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cbe9f-3d6a-4547-bdcb-ec95d567a104 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.916262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:10.951728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:10.952084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.952246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.952529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.953207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:10.953515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:10.955032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a31262-6fb2-4b2b-ae3b-f1dfb06375de None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:10.966153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 56/122] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:10.967471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:10.967759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:10.968031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:10.980542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0de931-f74b-45d7-9e2f-0b5a4d0c060e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:10.994400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:10.996966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:11.033093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.034253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.034916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.036322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.037040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:11.037358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.038846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.050845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 67/123] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.052820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.071663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 57/124] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:11.072526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.147791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.180886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc912a23-004d-46cb-9871-2c80304ffab8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.196455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b328-dfd5-42ac-8f3a-76c45f041333 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.198191 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.227164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.227814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.228055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.228337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.229563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.231042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.232907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 68/125] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.233751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.241684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.242621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.243135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.243605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.244942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.246678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.248731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 58/126] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.249709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.355596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365abca4-3bc7-40d9-bd6e-39643cfe00a0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.391763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.392721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.393177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.393623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/e632ab14fc6d4687bca9af60a4b88241/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.401714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, user_id=e632ab14fc6d4687bca9af60a4b88241, role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.403434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.414740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09c509-5f25-4bd2-a4a3-ba87709be81f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.428835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 59/127] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:11 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/e632ab14fc6d4687bca9af60a4b88241/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:11.429944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.490361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.491406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.491890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.492362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.494617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.496381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.506690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 69/128] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.509082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.513969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.541568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.671915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d7d-d848-42f4-b729-023a32a06f11 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.680627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0cf06-9845-4f36-b867-dac9c4e5a7f3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.711137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.711841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.712186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.712572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.714070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.715747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.715938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.716389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.716675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.716951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.717650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 70/129] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.718083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.718495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.719565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.721180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 60/130] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:11.727650 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.808727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.831103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:11.837239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c09d0-f537-499b-ab9a-c4c147cd4980 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.838280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4d80-7a03-4c7f-abc8-97382e8bbf73 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:11.877762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.878559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.878862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:11.878974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.879219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.880331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:11.880788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:11.881256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/6b441038ebcb444080c635316cb2b19a/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:11.884824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, user_id=6b441038ebcb444080c635316cb2b19a, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:11.886301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:11.893769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:11.900699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:11.902758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:11.904658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 71/131] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:11.910316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:11.910631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 61/132] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:11 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/6b441038ebcb444080c635316cb2b19a/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:11.923800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:12.037310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea1ce-aae9-4a61-b919-7b4f0b73667c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:12.084743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:12.085537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:12.085836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:12.086213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/e632ab14fc6d4687bca9af60a4b88241/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:12.088471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, user_id=e632ab14fc6d4687bca9af60a4b88241, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:12.090068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:12.094995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c816f-1da7-4555-8069-4ad7a0335e93 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:12.099834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:12.109063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 72/133] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:11 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/e632ab14fc6d4687bca9af60a4b88241/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:12.136042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:12.136672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:12.136956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:12.137236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:12.137934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:12.138244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:12.139806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:12.151054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 62/134] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:12.156838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:12.291076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ac2d8-54c6-400d-8c42-26bdd445ffbc None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:12.328337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:12.328990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:12.329274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:12.329553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:12.330739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:12.332225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:12.334427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 73/135] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:12 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:12.340221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:12.368640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:12.459080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00fba-778c-4a69-a412-1f066429705f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:12.504852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:12.505501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:12.505789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:12.506067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] PATH_INFO: `/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:12.511354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] RBAC: Authorizing `identity:get_project(project_id=b5419a4bd6134e65b4a6c630c5adcef9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:12.512824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43fca-5b89-4e1b-a2e2-7a34b098d4fa None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:12.514800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 63/136] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:12 2022] GET /identity/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:12.520969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:12.613585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:12.656185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f61a-f35c-4c49-8fb8-8dcef56dd7ca None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:12.693830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:12.694873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:12.695358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:12.695829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] PATH_INFO: `/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9/users/e632ab14fc6d4687bca9af60a4b88241/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:12.698049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5419a4bd6134e65b4a6c630c5adcef9, user_id=e632ab14fc6d4687bca9af60a4b88241, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:12.699745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3db38-7ec0-4e8c-b92d-3812fd8adcf8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:12.715086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 74/137] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:12 2022] PUT /identity/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9/users/e632ab14fc6d4687bca9af60a4b88241/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:13.186354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdab5-7ade-4d83-9957-f85b33b40d5c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:13.186752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdab5-7ade-4d83-9957-f85b33b40d5c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:13.186950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdab5-7ade-4d83-9957-f85b33b40d5c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:13.188451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 64/138] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:13.194791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:13.195611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:13.197148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:13.217664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:13.219221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:13.313680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 75/139] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:13.842352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdab5-7ade-4d83-9957-f85b33b40d5c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:13.955412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:13.987733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdab5-7ade-4d83-9957-f85b33b40d5c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:14.024653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:14.025626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.026128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.026623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.037957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-0acf89cc-b91b-4ebb-9b02-4ebcd821669e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:14.043049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:14.043912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:14.044678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:14.047279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 65/140] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:14.056017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:14.130920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:14.132164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c35-9864-493d-8604-ff673bb8ea7e None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.132344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c35-9864-493d-8604-ff673bb8ea7e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.132748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c35-9864-493d-8604-ff673bb8ea7e None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.133964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 66/141] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:14.140048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.140048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.140048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.160061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:14.161800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:14.209982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc86a61-617b-4dad-a844-37103e4d62af None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:14.237692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 67/142] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:14.257472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:14.258410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.258980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.259451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.260465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:14.260966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:14.262558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:14.272139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 76/143] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:14.277606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:14.403580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:14.425560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca520b-5924-4744-bb92-c48b8e8fbab9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:14.462052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:14.462711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.462998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.463271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] PATH_INFO: `/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.464433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] RBAC: Authorizing `identity:get_user(user_id=5f13b112f8414a3fba9e14a30e3cb9dc)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:14.465884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad91b97-e6e7-4f40-bfef-322a3c2f3f2b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:14.467486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 68/144] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:14 2022] GET /identity/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:14.473016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:14.605936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b64fe-5935-4f38-bf04-5e6919e52031 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:14.627174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:14.649876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9b75-16b1-4d46-99c7-3950d15dfec1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.650171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9b75-16b1-4d46-99c7-3950d15dfec1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.650429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9b75-16b1-4d46-99c7-3950d15dfec1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.651985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 69/145] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:52:14.655191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:14.655775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.656053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.656328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.657461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:14.658948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:14.661365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 77/146] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:14 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:14.667705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.667994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.668266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.673599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:14.697804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:14.700794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:14.805340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 70/147] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:14.833475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:14.870886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd554a8-0ca1-4bdb-9c22-5a1309bf366f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:14.931468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:14.932348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:14.933449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:14.934403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/5f13b112f8414a3fba9e14a30e3cb9dc/roles/fc092d43359d4c499a73ea3a6be74b2b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:14.938851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, user_id=5f13b112f8414a3fba9e14a30e3cb9dc, role_id=fc092d43359d4c499a73ea3a6be74b2b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:14.940528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:14.952738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:14.965657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 78/148] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:14 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/users/5f13b112f8414a3fba9e14a30e3cb9dc/roles/fc092d43359d4c499a73ea3a6be74b2b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:14.996038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffe1f6-1d6a-4b2e-9ea4-386bb1535958 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:15.068457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:15.069215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.069501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.069773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.071146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:15.072635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:15.074697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 71/149] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:15.080239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.157810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:15.202164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.259275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174802-b46f-4be1-a1ec-50a246d7417c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:15.327848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:15.328483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.329100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.329390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.330350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:15.333297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30deb2c5-adc6-4377-87ca-8577fc78712a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:15.362800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 79/150] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:15 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:15.364648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ae41-3466-4b1c-b0d6-8f2087315615 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.364939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ae41-3466-4b1c-b0d6-8f2087315615 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.365485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4ae41-3466-4b1c-b0d6-8f2087315615 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.367490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 80/151] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:15.373407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8411ef3-f943-4485-bb37-766387ea154f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:15.373611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.373805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.374056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.399641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:15.401437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:15.417732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:15.418389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.418730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.419319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.434538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:15.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:15.441240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:15.442280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:15.446759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 72/152] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:15.448442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.466363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:15.513824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 81/153] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:15.603337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68313c-e57d-4342-97e0-ca8001790606 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:15.654700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:15.655370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.655655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.655928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.656600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:15.656905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:15.658313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:15.667850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 73/154] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:15.673698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.706233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:15.803061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59f214-7bae-4bd7-9c43-0797c13baade None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:15.842744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.851384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:15.852113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:15.852399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:15.852678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:15.854068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:15.855566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:15.859615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 82/155] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:15 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:15.864964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:15.939692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.008249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.011271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa404ff-96a1-4358-bd1f-68821cfcab03 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.014913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592c8c-60cf-4318-945e-627b4d67ba3f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.049288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.050054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.050442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.050857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.057891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.058780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.059226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.059648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.077739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4036181e-abcc-45f9-96c0-305709d66b36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:16.084605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:16.085729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:16.086635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:16.088508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 74/156] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:16.089585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518fbc-bfbd-49be-8780-262ec23f1637 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.089877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518fbc-bfbd-49be-8780-262ec23f1637 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.090159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518fbc-bfbd-49be-8780-262ec23f1637 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.091618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 75/157] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:16.095500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518fbc-bfbd-49be-8780-262ec23f1637 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.149631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:16.151153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab658fe-43ae-4b81-81a1-03c5a71db1ec None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:16.238229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518fbc-bfbd-49be-8780-262ec23f1637 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.272451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.280380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.281325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.282352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.282911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.284724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:16.284842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 83/158] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:16.285374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:16.285817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.286146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.286434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.287859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b201df-e85a-4ad0-bfe8-baf145d632ce None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:16.290990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.299036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 76/159] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:16.300659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3834f-5073-41ff-8cf8-7e2f7dfda7bf None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.302347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3834f-5073-41ff-8cf8-7e2f7dfda7bf None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.302919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3834f-5073-41ff-8cf8-7e2f7dfda7bf None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.305025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 77/160] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:16.305989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3834f-5073-41ff-8cf8-7e2f7dfda7bf None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.308661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:16.310885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:16.403246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 84/161] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:16.404180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.462956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3834f-5073-41ff-8cf8-7e2f7dfda7bf None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.520858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619b3f6-eb05-42b0-af0c-ec53455266a7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.547368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.548218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.548611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.548989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.550360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:16.552438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438442-0fa7-49ac-9e48-9824ea37525e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:16.554492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 78/162] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:16.555887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.556333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.556762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.556936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.564828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.565347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.565629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.565908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] PATH_INFO: `/v3/users/6b441038ebcb444080c635316cb2b19a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.570229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] RBAC: Authorizing `identity:get_user(user_id=6b441038ebcb444080c635316cb2b19a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:16.571747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:16.575633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 85/163] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/users/6b441038ebcb444080c635316cb2b19a => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:16.580872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.599894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:16.601106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:16.704323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:16.729725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 79/164] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:16.732011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.753792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187de8f-1f7d-40f4-8735-09835b43e73b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.826166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:16.826734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:16.827016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:16.827286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:16.828092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:16.828407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:16.829857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:16.842230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 86/165] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:16.844136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:16.950791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6aec-9369-4573-9f78-3c15aa14901f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:16.970828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:17.048019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.048789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.048973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.049214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.057011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06565d26-a761-4f78-a91b-5afe59b52242 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.144656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.145928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.146220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.146495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.181196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:17.195065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:17.196237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:17.197112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:17.198122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 87/166] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:17.198826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:17.219962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:17.222414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:17.372244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 80/167] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:17.373068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:17.484266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:17.496252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89207b3-9bf0-48c4-9c7d-d6fff13b78e2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.520166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed1b3-49da-4fe0-be29-1bfd9f4e9270 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.547370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.548246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.548706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.549126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.550482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:17.550995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:17.554235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:17.571009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:17.572285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 81/168] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:17.573131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:17.597557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.598399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.599685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.600189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.629543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:17.634562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:17.636051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 88/169] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:17.637436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:17.741174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f662-e17a-4b29-b896-c69512eb193e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.787889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.788891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.789320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.789760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.791346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:17.793711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:17.795590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 82/170] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:17.796596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:17.819079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:17.923115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59c4b-ecd1-4114-a3f9-46086f5633ae None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.924850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8799-8b42-402f-8aed-f230136fc8c8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:17.968342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:17.969339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:17.969892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:17.970367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:17.971454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:17.972089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:17.974870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:17.985514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 83/171] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:17.986591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.055511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:18.056101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:18.056389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:18.056670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:18.061871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:18.062573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:18.066994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 89/172] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:18.066994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.166235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:18.193124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44010a1c-e228-445b-8b4c-6a223fd9a227 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:18.231476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:18.231822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:18.232979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:18.233492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:18.234004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:18.234990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=6b441038ebcb444080c635316cb2b19a) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:18.235508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:18.237342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:18.244667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 84/173] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:17 2022] GET /identity/v3/role_assignments?user.id=6b441038ebcb444080c635316cb2b19a&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:18.245795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.375448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76321b69-057a-487a-8bb4-8c04ecf9a881 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:18.418975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49b7b-0eac-41a7-b886-92ad41b49188 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:18.433018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:18.434755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:18.435304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:18.435851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:18.467063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:18.539120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:18.541237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:18.568032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:18.568766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:18.569046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:18.569325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] PATH_INFO: `/v3/users/e632ab14fc6d4687bca9af60a4b88241` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:18.573042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] RBAC: Authorizing `identity:get_user(user_id=e632ab14fc6d4687bca9af60a4b88241)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:18.574518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:18.576513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 90/174] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:18 2022] GET /identity/v3/users/e632ab14fc6d4687bca9af60a4b88241 => generated 275 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:18.583507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.658064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 85/175] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:18.664182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.759055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:18.789242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd87a17-5c0b-40de-92c4-7cb25f6f637c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:18.835544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:18.836210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:18.836496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:18.836777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:18.838569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:18.840382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:18.842360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 86/176] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:18 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:18.847943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:18.924709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3a11-edf0-44ff-857a-6d7751dd3e95 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:18.972549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:18.987301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8e3ca-70cf-4838-b7fc-c2ebac2ccec3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:19.011041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:19.025901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:19.026530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.026840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.027115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.065950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:19.066564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.066873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.067150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.068019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:19.068327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:19.069765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4603aee-f583-4633-aa92-e45a2251a717 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:19.086537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 87/177] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:18 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=1197acedde154542b162281404f9b02c => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:19.087827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e38e-ebc1-4b83-9c1c-f087583e0ddc None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.088115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e38e-ebc1-4b83-9c1c-f087583e0ddc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.088391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e38e-ebc1-4b83-9c1c-f087583e0ddc None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.089664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 88/178] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:19.096090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.096372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.096644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.150359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:19.151821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:19.186319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:19.187743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:19.311825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 89/179] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:19.345408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 91/180] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:19.351314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:19.476760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e628c-7eea-47ba-9210-61415b90c1b3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:19.480557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:19.523893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:19.525164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.525658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.526142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] PATH_INFO: `/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.531332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=b5419a4bd6134e65b4a6c630c5adcef9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:19.533013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa99eb1-6e71-4964-a0f7-5f341a4e8fc1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:19.534895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 90/181] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:19 2022] GET /identity/v3/projects/b5419a4bd6134e65b4a6c630c5adcef9 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:19.541761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:19.554817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8f17-cbbc-42a0-a282-4cd3e12c1714 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.556852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8f17-cbbc-42a0-a282-4cd3e12c1714 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.557330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b8f17-cbbc-42a0-a282-4cd3e12c1714 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.558904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 91/182] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:19.568034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:19.568475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.569288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.569288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.603682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:19.607154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:19.715015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580877-713a-4c3b-a1d8-6d51d700de1c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:19.740689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 92/183] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:19.803881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:19.807867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:19.813365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:19.813651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:19.814044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:19.817767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=b5419a4bd6134e65b4a6c630c5adcef9, user.id=e632ab14fc6d4687bca9af60a4b88241) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:19.818353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:19.819961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:19.829391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 92/184] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:19 2022] GET /identity/v3/role_assignments?user.id=e632ab14fc6d4687bca9af60a4b88241&scope.project.id=b5419a4bd6134e65b4a6c630c5adcef9&role.id=1197acedde154542b162281404f9b02c => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:19.978433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f6ff2-03ae-4cf0-a174-888490bb9376 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:19.981460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.052393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.053438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.053789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.054111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.078107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:20.083730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:20.084680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:20.086020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 93/185] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:20.091166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.121481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.214139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.235924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfb3e0-8571-46a2-89fd-73c4c3440ddd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.282163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ddde-8a8d-4552-bd80-416b323ccfb5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.287315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.289507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.289507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.289507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.292966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:20.292966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:20.294383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f9bf-6203-4516-8797-c4aeba936770 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:20.305451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 93/186] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:20.307520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49dc6-bc3c-4b7f-b0c9-3a97b0c71453 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.307520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49dc6-bc3c-4b7f-b0c9-3a97b0c71453 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.307520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb49dc6-bc3c-4b7f-b0c9-3a97b0c71453 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.308676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 94/187] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:20.309686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ebf7-9251-4664-8fc9-d3c6287e913c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.310155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ebf7-9251-4664-8fc9-d3c6287e913c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.310440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443ebf7-9251-4664-8fc9-d3c6287e913c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.312006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 95/188] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:20.312814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443ebf7-9251-4664-8fc9-d3c6287e913c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.331006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.331645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.331923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.332193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.346210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4cf69225-6f5e-4678-affb-d200c874204f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:20.352179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:20.353096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:20.353988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 94/189] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:20.354700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3556-4232-4936-85c5-28aecc10351f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.356195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3556-4232-4936-85c5-28aecc10351f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.356195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be3556-4232-4936-85c5-28aecc10351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.373763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-24be3556-4232-4936-85c5-28aecc10351f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:20.374973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-24be3556-4232-4936-85c5-28aecc10351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:20.392513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.422506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443ebf7-9251-4664-8fc9-d3c6287e913c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.443723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 95/190] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:20.445127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.445419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.446057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.455756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.456439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.456724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.456998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] PATH_INFO: `/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.458188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] RBAC: Authorizing `identity:get_user(user_id=5f13b112f8414a3fba9e14a30e3cb9dc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:20.460398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:20.461975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 96/191] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/users/5f13b112f8414a3fba9e14a30e3cb9dc => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:20.462766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.473064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:20.474259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:20.478905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.544122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 96/192] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:20.552823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.571067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6dd35-7e42-449d-a275-1d6c7b786511 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.607021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.608141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.608141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.608541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.609300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:20.609725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:20.611243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:20.620610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 97/193] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:20.628347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.667519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.690085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed07ba-b70d-4860-be21-99c2ccf607d8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.726442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.727105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.727382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.727649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.731901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.759821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3f053-9b5c-46e0-9bd7-7db00a07dd6b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.795684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.796350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.796631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.796905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.803602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:20.805110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:20.811004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:20.812467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:20.819367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 98/194] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:20.819367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.893051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.913335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 97/195] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:20.914161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:20.924451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cb894-4095-4dfc-a108-08d8811f7ecd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:20.953470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:20.959786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:20.960434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:20.960715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:20.960990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:20.971113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:20.976599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:20.977496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:20.978338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 99/196] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:20.979635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.021611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6e67a-e91d-479c-b0de-bf86dbdb3af7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.054708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.055240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.055520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.055796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.084066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35acdea-ddf5-407f-a47c-820e77a29995 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.106119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.119071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.119708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.119993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.120268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.121373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.122881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.124469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 100/197] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.125231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.127908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.129360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.185430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.225925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51698a-478d-41c6-8469-9a75b7e5c721 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.232556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 98/198] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:21.233394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.261098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.261736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.262016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.262292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.263422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.264869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.266498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 101/199] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.267337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.314905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.333356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ee28f-238f-405c-9d74-08e1e8e81d64 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.367444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc61460-e526-4839-9569-04119ca823bb None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.367636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.368148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.368430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.368711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.369371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:21.369677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.371098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.378970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 99/200] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.379766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.396501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.405284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.405896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.406177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.406451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.407150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.408590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.430407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 102/201] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:21 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:21.431456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.499237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bb5c9-fb6d-4373-a242-87ba30f39bbb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.539481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.540233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.540590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.540939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.542216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.543845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.545778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 100/202] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.546364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.558148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347b2e-148d-4bc1-bdb2-20ddd5a0bdf0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.566095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.600639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.601269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.601541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.601818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.602570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff, user.id=5f13b112f8414a3fba9e14a30e3cb9dc) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:21.602917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.604562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.610644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 103/203] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/role_assignments?user.id=5f13b112f8414a3fba9e14a30e3cb9dc&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.611137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.679075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f0ea1-5894-4b92-adf9-501f19281622 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.694977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.728438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.729434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.729723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.730001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.731666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.733165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.735176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 101/204] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.741565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:21.769916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd8c8-9fca-4284-89bf-43fcc966c210 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.820375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.821538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.822052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.823005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:21.824037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=73bf7839a02c470991ba80054c339deb) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:21.824565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:21.826960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:21.835252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 104/205] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/role_assignments?user.id=73bf7839a02c470991ba80054c339deb&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:21.878601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:21.902073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e33c1-a0f2-4488-8516-5c1f1d89ffcc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:21.945258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:21.945888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:21.946169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:21.946447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:22.040984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:22.040984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:22.126074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:22.148536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 102/206] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:22.154192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:22.262992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ef78-39c4-4715-b656-564ac436af4c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:22.277891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:22.299845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:22.300478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:22.300755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:22.301027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:22.302700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:22.304640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d224ee4-ff88-434d-992e-882ee6178bc0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:22.306468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 105/207] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:22 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:22.312128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:22.420157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c0c0-dd43-4483-a475-98527b04d99a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:22.461222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:22.461861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:22.462146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:22.462427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:22.463253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=73bf7839a02c470991ba80054c339deb) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:22.463558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:22.465023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c99e-a58c-4df4-8f60-95056c6b5fb5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:22.471310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 103/208] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:22 2022] GET /identity/v3/role_assignments?user.id=73bf7839a02c470991ba80054c339deb&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:23.929622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8370-1992-4a02-b0d4-30717a526d3b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:23.930672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8370-1992-4a02-b0d4-30717a526d3b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:23.931177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad8370-1992-4a02-b0d4-30717a526d3b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:23.932720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 106/209] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:23.935028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9078f4-dbc0-4968-8f19-8d35428fea19 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:23.935409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9078f4-dbc0-4968-8f19-8d35428fea19 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:23.935599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9078f4-dbc0-4968-8f19-8d35428fea19 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:23.937996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729702-0db6-4a30-aab5-71a0a9dd94cb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:23.938282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729702-0db6-4a30-aab5-71a0a9dd94cb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:23.938561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729702-0db6-4a30-aab5-71a0a9dd94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:23.939104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 104/210] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:23.944616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1941b-6d78-46d7-a339-4460646554e3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:23.945292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1941b-6d78-46d7-a339-4460646554e3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:23.945773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1941b-6d78-46d7-a339-4460646554e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:23.969785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7d729702-0db6-4a30-aab5-71a0a9dd94cb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:23.971021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7d729702-0db6-4a30-aab5-71a0a9dd94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:23.984890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3cf1941b-6d78-46d7-a339-4460646554e3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:23.986075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3cf1941b-6d78-46d7-a339-4460646554e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:24.034153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:24.071682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 107/211] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:24.079307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 105/212] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:24.145287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4d006-31be-49c5-8e77-8d084296573e None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.145966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4d006-31be-49c5-8e77-8d084296573e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.146506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4d006-31be-49c5-8e77-8d084296573e None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.148357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 108/213] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:24.153906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.154439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.154957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.175001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:24.176486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:24.249727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 106/214] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:24.342939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4d006-31be-49c5-8e77-8d084296573e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.362054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.451248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4d006-31be-49c5-8e77-8d084296573e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.464182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:24.475240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402748d-ca94-4c6f-84b2-0cd8666cee18 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.477557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:24.495881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.496579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.496869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.497151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.498268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:24.500351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:24.502414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 109/215] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:24.508249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.520659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.522739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.523662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.524504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.539830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:24.546893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:24.547886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:24.548737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:24.551018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 107/216] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:24.552652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.625901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a8d7-e16a-4ef7-a42c-c3d7e94fac9f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.663801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.664415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.664693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.664967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.665630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:24.667078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:24.673270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede94dd5-794c-4343-b52d-eb715c9dc326 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.698681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 110/217] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:24 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:24.698681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.723641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.724502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.724789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.725066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.728334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:24.739043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-0f2b7459-601c-4fa5-89a6-6cb5fcfd2e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:24.744335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:24.745361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:24.746205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 108/218] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:24.752092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcf10-1194-4a6e-9834-ae09c6c0f5a2 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.752303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcf10-1194-4a6e-9834-ae09c6c0f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.752588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adcf10-1194-4a6e-9834-ae09c6c0f5a2 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.754996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 109/219] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:24.758940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adcf10-1194-4a6e-9834-ae09c6c0f5a2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.787337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:24.817139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b9bcb-2b40-47d0-b574-80db86019c67 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.859604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.860398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.860784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.861167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.862432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:24.862897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:24.864589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39db57-d362-4b93-b0f0-1de37c66133d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:24.874310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 111/220] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:24.875836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.876226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.876604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.877893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adcf10-1194-4a6e-9834-ae09c6c0f5a2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:24.898350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:24.899571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:24.918440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:24.919271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:24.919618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:24.919985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:24.920753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:24.921150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:24.922607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:24.931703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 110/221] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:24.932723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:24.991478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 112/222] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:24.992276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.029405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.067195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.095582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59095e0f-6e27-42c8-9121-08e11f8f987b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.135321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc9867-68b0-42b2-ae6b-f3468d1449b3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.141201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.141848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.142130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.142407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] PATH_INFO: `/v3/users/df4ed1ab8fc94496b2bead76e6721b1e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.163254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] RBAC: Authorizing `identity:get_user(user_id=df4ed1ab8fc94496b2bead76e6721b1e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.164649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.166467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 111/223] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/users/df4ed1ab8fc94496b2bead76e6721b1e => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:25.172048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.185447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.186102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.186380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.186649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.189238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.190789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.192734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 113/224] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:24 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:25.198194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.291265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ec03d-b15c-4626-9b3e-5d1f118850d5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.305318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.312268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060ebc-5f70-459b-be65-14aa56a76aac None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.330582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.331635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.332118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.332586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.348780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.349597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.349842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.350246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.350881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.351874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.353599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.355320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 114/225] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:25.356099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.411931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.413755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.464255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb7f4-de8b-4b86-8a7b-a2bf40283ad5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.499804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.500290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.500571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.500841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.512414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:25.517442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:25.518326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:25.519181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 115/226] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:25.519851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.525616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 112/227] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:25.531090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.546994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.579223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.635717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c23702-b9a5-45a7-9895-31a52f2cd1d4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.645261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db2020-2917-4226-970a-ac319c8d67f8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.675567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.676552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.677037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.677722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.678571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:25.679118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.680759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.689812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 113/228] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:25.691009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.696959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.697647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.697926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.698205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/73bf7839a02c470991ba80054c339deb/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.700340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, user_id=73bf7839a02c470991ba80054c339deb, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.701791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.722697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 116/229] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:25 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/73bf7839a02c470991ba80054c339deb/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:25.722697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.830226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.858118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b914a-3bc9-4b18-9328-b1f450090408 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.880304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b039-a220-4004-9c8f-c6e334ccf60a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:25.898217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:25.926184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.926867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.927155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.927948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.930516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.932969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.934703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 117/230] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:25.941634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:25.959353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:25.959947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:25.960239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:25.960516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:25.963691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:25.965278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:25.969892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 114/231] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:25.984433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:26.103904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5759e6-e922-4ae1-816d-81af131be494 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:26.113980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9dbbd-652b-4dc9-abee-57ab08472b73 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:26.145672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:26.147551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:26.148177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:26.148740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:26.150325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:26.152150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:26.153695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:26.154307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:26.158683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:26.158683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:26.158683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=df4ed1ab8fc94496b2bead76e6721b1e) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:26.158683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:26.158683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bed5c-6034-46aa-886e-e84f02f9fc85 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:26.159362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 118/232] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:26.161524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:26.163464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 115/233] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:25 2022] GET /identity/v3/role_assignments?user.id=df4ed1ab8fc94496b2bead76e6721b1e&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=1197acedde154542b162281404f9b02c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:26.195141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:26.298150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1568a4-c98f-43de-8ac2-cd2a70b35546 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:26.346152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:26.346918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:26.347201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:26.347471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/73bf7839a02c470991ba80054c339deb/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:26.350352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, user_id=73bf7839a02c470991ba80054c339deb, role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:26.351851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04fd40-184d-4509-b003-6c41dd712510 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:26.366933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 119/234] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:26 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/73bf7839a02c470991ba80054c339deb/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:27.374739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc8e-0da4-4273-925e-654a6cc9459c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:27.375705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc8e-0da4-4273-925e-654a6cc9459c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:27.376208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6cc8e-0da4-4273-925e-654a6cc9459c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:27.377966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 116/235] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:27.383713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:27.384698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:27.385222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:27.411590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:27.413143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:27.453307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8162-6f7d-4069-bf39-1f5e21dbc443 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:27.454253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8162-6f7d-4069-bf39-1f5e21dbc443 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:27.455003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8162-6f7d-4069-bf39-1f5e21dbc443 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:27.456760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 117/236] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:27.462706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:27.463236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:27.463702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:27.500123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:27.501349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:27.518426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 120/237] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:27.543583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:27.583401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 118/238] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:27.953845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:27.968603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:28.043341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:28.158954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20f5e7-785e-48d6-8df1-4ec23affc8c2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.234422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.235018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.235301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.235579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.243322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60674-d80b-471f-9d7a-85b4e9529e96 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.280054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.280702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.281049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.281329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.282443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:28.284285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:28.286254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 119/239] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:28.291633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:28.299305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:28.305206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:28.306118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:28.307172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 121/240] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:28.311882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:28.343043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:28.451050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb225-435a-4f00-8cb5-33d8ce8af48f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.456042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:28.506428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.506788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.507005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.507281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.507935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:28.509385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:28.528350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b569c-a283-44db-9a8c-b54a8adfab02 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.569797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 120/241] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:28 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:28.577948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.578591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.578907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.579183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.579926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:28.580201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:28.581653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b56bd-230f-4328-977c-1422a95678a7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:28.592620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 122/242] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:28.600390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:28.692829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1f6b-eedb-451a-8d01-40e3d5880ac3 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.694280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1f6b-eedb-451a-8d01-40e3d5880ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.694993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c1f6b-eedb-451a-8d01-40e3d5880ac3 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.697109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 123/243] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:28.701229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8bf56-8e68-4d54-a82c-2f13d46a9a76 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.701490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8bf56-8e68-4d54-a82c-2f13d46a9a76 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.701709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8bf56-8e68-4d54-a82c-2f13d46a9a76 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.703127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 124/244] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:28.704263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be392-8294-451e-90b7-6a73bd29df0b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.704550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be392-8294-451e-90b7-6a73bd29df0b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.704822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be392-8294-451e-90b7-6a73bd29df0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.724238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-239be392-8294-451e-90b7-6a73bd29df0b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:28.726220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-239be392-8294-451e-90b7-6a73bd29df0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:28.749164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:28.761766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862fd16-0440-43ff-b99d-5bacdb40d474 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.807012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.807668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.807947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.808222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] PATH_INFO: `/v3/users/217ac7115b88497d8ef62bfc2f07d725` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.815023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 125/245] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:28.816070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.816348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.816619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:28.823655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] RBAC: Authorizing `identity:get_user(user_id=217ac7115b88497d8ef62bfc2f07d725)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:28.825133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:28.827555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 121/246] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:28 2022] GET /identity/v3/users/217ac7115b88497d8ef62bfc2f07d725 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:28.832792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:28.852820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:28.854403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:28.919615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:28.933790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 126/247] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:28.944501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056ae08-3927-4ce4-9669-b2d293d2226c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:28.982362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:28.983357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:28.983858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:28.984355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.006268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.060587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:29.062874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eefb2-54bc-489f-a2b6-360baf128351 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:29.116604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.182073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 122/248] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:52:29.183826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587b86-aa8e-4548-b5d7-326a66b5ba40 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.184315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587b86-aa8e-4548-b5d7-326a66b5ba40 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.184954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae587b86-aa8e-4548-b5d7-326a66b5ba40 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.186641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 123/249] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:29.187600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae587b86-aa8e-4548-b5d7-326a66b5ba40 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.250748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23789e-7d76-4087-a4d0-110eacc8f2fc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.251100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.299758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:29.300891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.301176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.301741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.315510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-9c555f22-0080-4811-a37b-3b7bc16a7ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:29.322888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:29.324026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:29.325064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 127/250] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:29.325896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.325896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.326039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.326585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae587b86-aa8e-4548-b5d7-326a66b5ba40 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.351741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:29.353452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:29.374292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:29.375023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.375371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.375576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.376747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:29.378806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:29.380570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 124/251] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:29.387456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.416225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.446682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 128/252] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:29.446682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.530488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa750c-c2b7-44ea-a173-f0bfcafd8ccb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.550578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.573682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:29.574861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.575348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.575818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.578417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9976f4-e8a5-4a0b-923d-bb075f2f2ca3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.600750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:29.605832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:29.606977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:29.608001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 125/253] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:29.608653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.666458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:29.667119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.667403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.667682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.668363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:29.668670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:29.670072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:29.690192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 129/254] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:29.691067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.755826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b4b8d-94b2-48ed-9fa2-37ed8f4a39c8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.770714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.823779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:29.824323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:29.824606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:29.825227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:29.826062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=217ac7115b88497d8ef62bfc2f07d725) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:29.826737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:29.828520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:29.837315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 126/255] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/role_assignments?user.id=217ac7115b88497d8ef62bfc2f07d725&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:29.838314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:29.875548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ef68e-a0d8-4035-9cde-381f8f102bf8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:29.891743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:29.961888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6059c-a19a-4133-9e13-8df809569bef None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.001765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.002529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.002930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.003330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.004591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.006791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.007429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.008060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.008351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.008638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.009165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 127/256] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:30.009313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:30.009651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.010145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.011046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.038890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 130/257] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:30.039770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.140689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97fb79-e9fb-49ac-b751-d90dfbea7ea0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.157634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:30.211508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.212153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.212438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.212717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.230123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:30.235458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:30.236332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 128/258] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:30.237385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.241745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb4d6-08d5-4298-9a17-36f4749bef33 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.250970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:30.297316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.297940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.298222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.298497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.434976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.436989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.457901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e8dc-2c96-49f4-b82d-6d8a1c845918 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.527480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.528136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.528522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.528809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] PATH_INFO: `/v3/users/df4ed1ab8fc94496b2bead76e6721b1e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.530092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] RBAC: Authorizing `identity:get_user(user_id=df4ed1ab8fc94496b2bead76e6721b1e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.531695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.533391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 129/259] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/users/df4ed1ab8fc94496b2bead76e6721b1e => generated 297 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:30.534158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.574090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 131/260] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:30.575000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.578293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:30.599201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:30.697947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cb1bf-e464-49b4-9b30-41f2975917cf None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.742790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c366-59b0-4f8b-ad13-db2841ad6bc8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:30.762342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.763001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.763288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.763568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.764244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:30.764555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.765953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.784040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 130/261] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:30.784899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.810287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:30.810973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:30.811257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:30.811531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:30.812688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:30.814156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:30.815841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 132/262] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:30.816609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:30.989552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.010916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.014688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42992cf-1dd3-457e-ac1f-022c6a82d044 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.039486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d60e76-33c8-4869-a44f-cf0295b5b24e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.089780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.090433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.090744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.091026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.095124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:31.096611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:31.107151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 131/263] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:31.108473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:31.121888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.122548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.122864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.123143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] PATH_INFO: `/v3/users/73bf7839a02c470991ba80054c339deb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.124299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=73bf7839a02c470991ba80054c339deb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:31.125783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:31.127423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 133/264] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:30 2022] GET /identity/v3/users/73bf7839a02c470991ba80054c339deb => generated 283 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:31.128183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:31.286756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14657a0-fbfd-4aaf-88ee-0fb63843e3b3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.296825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e7962-753f-455c-a737-9d79578654a7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.344482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.345367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.345655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.345932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/df4ed1ab8fc94496b2bead76e6721b1e/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.348206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, user_id=df4ed1ab8fc94496b2bead76e6721b1e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:31.349788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:31.367883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 132/265] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:31 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/df4ed1ab8fc94496b2bead76e6721b1e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:31.368775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:31.399532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.400178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.400724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.401013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.401800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=73bf7839a02c470991ba80054c339deb) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:31.402125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:31.403750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a7ba6-5b95-47ac-9e6a-c84425678da5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:31.418616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.429558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 134/266] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:31 2022] GET /identity/v3/role_assignments?user.id=73bf7839a02c470991ba80054c339deb&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:31.509962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610faf-1e0b-4cc1-96bc-1879e44cbbed None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.531839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f7e-fa12-4ea6-8910-215f9d24fdb1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.532168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f7e-fa12-4ea6-8910-215f9d24fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.532414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102f7e-fa12-4ea6-8910-215f9d24fdb1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.534114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 135/267] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:31.544326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8797-f272-4eef-a3f5-a60b8692ea40 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.544508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8797-f272-4eef-a3f5-a60b8692ea40 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.544789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8797-f272-4eef-a3f5-a60b8692ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.549951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.550596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.550895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.551170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.575087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.595859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ccfe8797-f272-4eef-a3f5-a60b8692ea40 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:31.597140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ccfe8797-f272-4eef-a3f5-a60b8692ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:31.638968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:31.640705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:31.679426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.722536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 136/268] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:31.722957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6138ae-3aad-494f-a753-67eaea0ae731 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.723251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6138ae-3aad-494f-a753-67eaea0ae731 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.725740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6138ae-3aad-494f-a753-67eaea0ae731 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.725740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 137/269] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:31.731361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.731644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.731918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.754051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:31.755265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:31.797924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 133/270] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:31.805756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:31.844698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 138/271] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:31.938691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51968e1-0235-4961-a6af-c4ce2b53bd3e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:31.970884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:31.995657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:31.997966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:31.997966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:31.997966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:31.999001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.000598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.002768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 134/272] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:31 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:32.009126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.096052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:32.141867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.156675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b787d8f-5a4c-4596-b63b-61c6fcfb085c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.227471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.228091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.228373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.228646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.229381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=73bf7839a02c470991ba80054c339deb) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:32.229692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.232729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.243806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 139/273] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/role_assignments?user.id=73bf7839a02c470991ba80054c339deb&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:32.244952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.325150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811268b4-8e3f-4d9c-93ed-6bbfbf53e019 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.368374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcac652-d8e1-4402-b22f-f9c0543d6f39 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.378078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.378766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.379052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.379326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.391524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:32.396399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:32.397404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:32.398243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 135/274] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:32.406949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.410931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:32.427520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.428797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.429088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.429434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.435594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.437175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01f5a4-75e0-4f8b-a006-ae8c10d83386 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.439306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 140/275] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:32.445884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f87d-a095-4306-b135-66de6886c790 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.446171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f87d-a095-4306-b135-66de6886c790 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.446442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f87d-a095-4306-b135-66de6886c790 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.449040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 141/276] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:32.452540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5f87d-a095-4306-b135-66de6886c790 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.475407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:32.528303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299460b-1831-445e-979c-e62d4eb11e3f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.576134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.576739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.577094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.577285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.577957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:32.578261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.579703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174ec1-2c94-4194-a588-14c90ffddab5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.580160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5f87d-a095-4306-b135-66de6886c790 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.593479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 136/277] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:32.595050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.595342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.595619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.618024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:32.619340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:32.630644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.630644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.631057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.631130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.631794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.634068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.666935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 142/278] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:52:32 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:32.668074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.718689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 137/279] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:32.755308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:32.805466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc8a3-721a-402b-b5ac-27667f0554d1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:32.843938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:32.844647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:32.844936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:32.845212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] PATH_INFO: `/v3/users/2fb12de3fc1743eab8cd13120b89aa63` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:32.859913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb12de3fc1743eab8cd13120b89aa63)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:32.861483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:32.863480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 143/280] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/users/2fb12de3fc1743eab8cd13120b89aa63 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:32.869954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:32.923854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:32.980679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc9d-d05e-4951-920a-c1b1fabc5513 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.020624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.021236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.021629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.022010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.022926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, user.id=2fb12de3fc1743eab8cd13120b89aa63, scope.system=all) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:33.023239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:33.024688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:33.030349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 138/281] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 22 16:52:32 2022] GET /identity/v3/role_assignments?user.id=2fb12de3fc1743eab8cd13120b89aa63&scope.system=all&role.id=1197acedde154542b162281404f9b02c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:33.042132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:33.180712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b63261-ec34-4e52-bf4b-498678b895a4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.195706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:33.233093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.233738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.234019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.234293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.247025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:33.251890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:33.252776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:33.254129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 144/282] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:33.259586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:33.415422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6754c-cee4-4ec8-9e68-8e8f2db2a528 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.438946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:33.471376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.472002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.472289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.472570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.473251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:33.473561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:33.475107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:33.484305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 139/283] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:33.489801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:33.606217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976bf7-f7dd-49c9-b58c-52c2010b6d0a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.642029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.642744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.643015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.643300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] PATH_INFO: `/v3/users/217ac7115b88497d8ef62bfc2f07d725` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.644495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] RBAC: Authorizing `identity:get_user(user_id=217ac7115b88497d8ef62bfc2f07d725)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:33.646019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:33.648330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 145/284] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:33 2022] GET /identity/v3/users/217ac7115b88497d8ef62bfc2f07d725 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:33.654195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:33.777054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b062-95e7-450a-bfef-3942b5336db6 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.820939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.821728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.822017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.822297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.823526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:33.824978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed26eb6-48d5-4759-ba8d-eafe7b4fd50b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:33.827069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 140/285] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:33 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:33.832827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:33.875537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:33.938318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83855c4-3e50-498f-95d0-205243d41b3e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:33.988534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:33.989596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:33.989943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:33.990232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/217ac7115b88497d8ef62bfc2f07d725/roles/fc092d43359d4c499a73ea3a6be74b2b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:33.992803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, user_id=217ac7115b88497d8ef62bfc2f07d725, role_id=fc092d43359d4c499a73ea3a6be74b2b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:33.994316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd671d01-dd02-4d4d-b6fd-d5f368562f33 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:34.014684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 146/286] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:52:33 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/users/217ac7115b88497d8ef62bfc2f07d725/roles/fc092d43359d4c499a73ea3a6be74b2b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:34.165428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264edfe-2778-4a4a-b9f4-c892effa4da2 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:34.165843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264edfe-2778-4a4a-b9f4-c892effa4da2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:34.166016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264edfe-2778-4a4a-b9f4-c892effa4da2 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:34.167442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 141/287] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:34.173326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:34.173626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:34.173896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:34.204599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:34.205815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:34.296393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 147/288] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:34.571889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264edfe-2778-4a4a-b9f4-c892effa4da2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:34.627253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:34.700313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264edfe-2778-4a4a-b9f4-c892effa4da2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:34.743597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:34.744235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:34.744516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:34.744791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:34.766646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:34.772813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:34.773984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:34.775390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 142/289] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:34.780138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:34.829503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:34.931053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72aee7-f7eb-465b-a2ec-9cd3e7f3f69c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:34.978926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:34.979555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:34.979837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:34.980118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:34.986762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:34.986762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:34.986762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:35.004896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 148/290] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:35.012569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:35.159725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6573f-3e56-46d6-977d-6d8fc217f1b8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:35.161292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:35.206214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:35.206883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.207165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.207438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] PATH_INFO: `/v3/users/df4ed1ab8fc94496b2bead76e6721b1e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.208599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] RBAC: Authorizing `identity:get_user(user_id=df4ed1ab8fc94496b2bead76e6721b1e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:35.210894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:35.212811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 143/291] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:35 2022] GET /identity/v3/users/df4ed1ab8fc94496b2bead76e6721b1e => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:35.218333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:35.353458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:35.363990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea031f-19e7-4493-8d82-16f4fc7ada73 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:35.425897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:35.426442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.426740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.427021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.520768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:35.522371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69335ad-290e-4d17-8f54-2efde0b4cfe9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:35.656329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:35.669395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 149/292] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:35.674633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:35.693860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f99b8-e822-4279-bfc9-47882ebb61ac None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.694445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f99b8-e822-4279-bfc9-47882ebb61ac None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.694951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f99b8-e822-4279-bfc9-47882ebb61ac None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.696599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 150/293] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:35.703919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde48aa8-ae10-4aa4-b64e-daaa9e0be2ae None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.704544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde48aa8-ae10-4aa4-b64e-daaa9e0be2ae None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.705013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde48aa8-ae10-4aa4-b64e-daaa9e0be2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.734038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-fde48aa8-ae10-4aa4-b64e-daaa9e0be2ae None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:35.735567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fde48aa8-ae10-4aa4-b64e-daaa9e0be2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:35.789832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee6a71-31a5-4d18-b7c3-d73cdb55cff5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:35.828514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:35.830162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.830640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.831127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.832990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:35.835647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6731b-1d06-45ea-b672-95a3dbb6ac9a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:35.837614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 144/294] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:35 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:35.839276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4580f6-ad90-4100-9aaf-345e3317579c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.839820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4580f6-ad90-4100-9aaf-345e3317579c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.840315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4580f6-ad90-4100-9aaf-345e3317579c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.841779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 145/295] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:35.848633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4580f6-ad90-4100-9aaf-345e3317579c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:35.858482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 151/296] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:35.859845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8d5c-c9aa-4a51-8852-237e8cc2e497 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:35.860151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8d5c-c9aa-4a51-8852-237e8cc2e497 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:35.860409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c8d5c-c9aa-4a51-8852-237e8cc2e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:35.898351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5e1c8d5c-c9aa-4a51-8852-237e8cc2e497 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:35.899589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5e1c8d5c-c9aa-4a51-8852-237e8cc2e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:35.906757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.003322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4580f6-ad90-4100-9aaf-345e3317579c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.019937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 152/297] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:36.024458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a829869-c26e-486c-b83c-3e453102a29a None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.024873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a829869-c26e-486c-b83c-3e453102a29a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.025274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a829869-c26e-486c-b83c-3e453102a29a None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.027971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 153/298] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:36.033774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.034391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.035858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.060087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.061001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.061426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.061845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.062817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=df4ed1ab8fc94496b2bead76e6721b1e) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:36.063289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.065957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.073390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:36.074903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:36.080142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 146/299] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:35 2022] GET /identity/v3/role_assignments?user.id=df4ed1ab8fc94496b2bead76e6721b1e&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=1197acedde154542b162281404f9b02c => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:36.144462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.180173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 154/300] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:36.204021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.343722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59635d14-732b-4d80-9ceb-1febe7e52615 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.345447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.383994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.384861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.385313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.385732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.396647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:36.403258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:36.404365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:36.405382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:36.407398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 147/301] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:36.414528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.486510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.523439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701b703-d50c-45b1-b88b-d8d376c3a17d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.573998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.575842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.576332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.576785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.577685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:36.578298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.580087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.590836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 155/302] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:36.592103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.617173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750a882-af05-4b89-8dba-b09ab881fb99 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.638831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.654190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.654853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.655132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.655401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.666109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:36.671317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:36.672236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:36.673079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 148/303] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:36.673740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.699684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.704132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0dcdd-3508-44e2-89db-8313cac6ec5e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.737653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.738280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.738562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.738858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.739963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.742078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265277-928b-409a-af82-7cb475dc9642 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.743684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 156/304] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:36.744792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e12-be14-4aa0-9471-14f77ec8e9bb None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.745077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e12-be14-4aa0-9471-14f77ec8e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.745351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e12-be14-4aa0-9471-14f77ec8e9bb None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.746717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 157/305] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:36.747274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44e12-be14-4aa0-9471-14f77ec8e9bb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.783381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff7cf7-8a27-42e4-b001-f07e782c1b1b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.817288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.817928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.818192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.818465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] PATH_INFO: `/v3/users/cda61fba945e449d86307dc34208e50e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.833701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] RBAC: Authorizing `identity:get_user(user_id=cda61fba945e449d86307dc34208e50e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.835338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.836947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 149/306] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/users/cda61fba945e449d86307dc34208e50e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:36.837691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.854880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44e12-be14-4aa0-9471-14f77ec8e9bb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.864985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.889010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.889544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.889833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.890106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.890796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:36.891104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.892471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932773f7-aaee-4e28-b19d-8eab501fdbbe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.900439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 158/307] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:36.900439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.900439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.900439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.920024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:36.921200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:36.921898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:36.941714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc226e-18dd-491e-aabb-9e5c3744b618 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:36.974739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:36.976127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:36.976418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:36.976710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] PATH_INFO: `/v3/groups` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:36.977329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:36.978807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:36.989441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 159/308] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:36.990290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:36.997390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 150/309] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Sep 22 16:52:36 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:36.998197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.133870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9292fb-46ed-47e5-8c6a-f12e354a3001 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.155747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc190-eac0-4026-b648-e826f0a073dc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.158156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:37.189744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.190818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.191307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.191584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] PATH_INFO: `/v3/users/2fb12de3fc1743eab8cd13120b89aa63` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.193628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb12de3fc1743eab8cd13120b89aa63)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:37.195396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:37.197204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 151/310] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/users/2fb12de3fc1743eab8cd13120b89aa63 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:37.203931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.204859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.205758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.205758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.206015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.207272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, user.id=cda61fba945e449d86307dc34208e50e, scope.system=all) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:37.207272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:37.208500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:37.218728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 160/311] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 22 16:52:36 2022] GET /identity/v3/role_assignments?user.id=cda61fba945e449d86307dc34208e50e&scope.system=all&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:37.219234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:37.280379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.333008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978210-e39a-4297-8b85-9672180bcd33 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.373860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.374539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.374902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.375181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] PATH_INFO: `/v3/system/users/2fb12de3fc1743eab8cd13120b89aa63/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.376816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2fb12de3fc1743eab8cd13120b89aa63, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:37.378223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:37.389334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 152/312] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Sep 22 16:52:37 2022] PUT /identity/v3/system/users/2fb12de3fc1743eab8cd13120b89aa63/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:52:37.412088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aebb2c-648c-4765-b299-29dd87b5574a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.457268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.458350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.458919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.459929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.472791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:37.478939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:37.479936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:37.480751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:37.488535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 161/313] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:37.490286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.572417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:37.608491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb373da-6186-4a40-b783-f0112ce3e4c4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.644643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.645655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.646168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.646646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.647934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:37.648458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:37.650124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:37.663204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 153/314] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:37.666439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.697284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:37.776759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606bf5-f150-4e84-99f7-ed8f850a48a9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.813889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.814998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.815480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.815950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] PATH_INFO: `/v3/users/217ac7115b88497d8ef62bfc2f07d725` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.817281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] RBAC: Authorizing `identity:get_user(user_id=217ac7115b88497d8ef62bfc2f07d725)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:37.819463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:37.825546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 162/315] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:37 2022] GET /identity/v3/users/217ac7115b88497d8ef62bfc2f07d725 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:37.827682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:37.936693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732e0b-ac08-4db5-88ca-da5846a7ad59 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:37.972311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:37.972930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:37.973209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:37.973479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:37.977735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:38.046685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:38.046685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:38.155426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 154/316] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:38.166834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:38.268499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:38.276085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb620-81d0-40b6-9515-34b186d80139 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:38.314471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:38.315186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:38.315476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:38.315747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:38.316873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:38.318323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57aadfe-7018-4c34-b5d2-44a1d07724a8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:38.325789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 163/317] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:38 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:38.327166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:38.361611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:38.435315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4bf6-be2b-4cb4-8d8d-be2bc5f60657 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:38.470960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:38.471575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:38.471858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:38.472136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:38.472859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416, user.id=217ac7115b88497d8ef62bfc2f07d725) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:38.473169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:38.474601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adac272-9694-4372-9334-96e848bc87a9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:38.486783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 155/318] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:52:38 2022] GET /identity/v3/role_assignments?user.id=217ac7115b88497d8ef62bfc2f07d725&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:39.369883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa710-0027-4fc5-8eca-92bc34fe9ad1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.370386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa710-0027-4fc5-8eca-92bc34fe9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.370488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa710-0027-4fc5-8eca-92bc34fe9ad1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.371963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 164/319] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:39.376872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2daafa-ffe1-406c-bca9-88be1ec41127 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.377260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2daafa-ffe1-406c-bca9-88be1ec41127 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.377416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2daafa-ffe1-406c-bca9-88be1ec41127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.396024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3f2daafa-ffe1-406c-bca9-88be1ec41127 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:39.397775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3f2daafa-ffe1-406c-bca9-88be1ec41127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:39.471587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 156/320] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:39.524591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f4f-3a3a-4cea-bb69-655f38028515 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.524876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f4f-3a3a-4cea-bb69-655f38028515 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.525325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39492f4f-3a3a-4cea-bb69-655f38028515 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.527097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 165/321] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:39.532432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.532727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.533004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.551639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:39.552810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:39.576629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:39.604986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498023b-c0c2-4d57-a0e2-ac5a1414a0e3 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.605273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498023b-c0c2-4d57-a0e2-ac5a1414a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.605538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498023b-c0c2-4d57-a0e2-ac5a1414a0e3 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.607048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 166/322] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:52:39.611724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.612007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.612280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.624574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 157/323] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:39.630971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:39.632195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:39.700389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 167/324] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:39.743252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:39.842877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358ffd4-2af3-4fc4-acde-1dd70f23aa63 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:39.877237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:39.877789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:39.878066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:39.878332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:39.879432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:39.880858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:39.883423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 158/325] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:39.888755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:39.894890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:39.926145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:39.984582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:39.994037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbcf94-f838-422e-baa4-bf60ce28f6a9 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.003590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8ef30-6bb8-40ae-b6ff-5fc4fd2af754 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.028584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.029187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.029467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.029742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] PATH_INFO: `/v3/groups` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.030381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.031847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.038882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.039751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.039969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.040239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.047085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 168/326] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Sep 22 16:52:39 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:52:40.047948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.061732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:40.067199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:40.068180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:40.070297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 159/327] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:40.075562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.166570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6d1ba-86ca-4a4f-be2d-0ca32622f24d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.181236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:40.200500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890018-3fa4-4ba1-951c-bdd03904dedd None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.204858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.205510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.205793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.206070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.218053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:40.223443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:40.224385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:40.225258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 169/328] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:40.230890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.244265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.245637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.245637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.245637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.246076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:40.246377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.247825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.248667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:40.257515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 160/329] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:40.263476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.351278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fea8-68b1-4432-b20c-3fb0534fbc58 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.391877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c3f97-f208-47c3-8e53-75c936dd493e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.403552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.403552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.404130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.404130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.404742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:40.407051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.407051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.416940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 170/330] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:40.425151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.437803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.438794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.439346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.439629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] PATH_INFO: `/v3/users/cda61fba945e449d86307dc34208e50e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.440940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] RBAC: Authorizing `identity:get_user(user_id=cda61fba945e449d86307dc34208e50e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.442833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.444631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 161/331] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/users/cda61fba945e449d86307dc34208e50e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:40.450132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.472743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:40.519842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:40.555301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1ef19-2def-4bfe-9f06-5f0adc6b5e50 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.580217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70518c-2549-470f-9ae5-41041410391d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.598906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.599552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.599836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.600111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] PATH_INFO: `/v3/users/2fb12de3fc1743eab8cd13120b89aa63` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.601990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb12de3fc1743eab8cd13120b89aa63)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.603590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.605620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 171/332] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/users/2fb12de3fc1743eab8cd13120b89aa63 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:40.610994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:40.629047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.629911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.630199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.630482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] PATH_INFO: `/v3/system/users/cda61fba945e449d86307dc34208e50e/roles/fc092d43359d4c499a73ea3a6be74b2b` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.634811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cda61fba945e449d86307dc34208e50e, role_id=fc092d43359d4c499a73ea3a6be74b2b)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.634811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c769-98c3-4c79-8e37-c37ffdbc2bb0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.645069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 162/333] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Sep 22 16:52:40 2022] PUT /identity/v3/system/users/cda61fba945e449d86307dc34208e50e/roles/fc092d43359d4c499a73ea3a6be74b2b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:52:40.742846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d826a6b-b0bb-4b03-bfb0-6d51cf5997c1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:40.785250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:40.786174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:40.786593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:40.787026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:40.788512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] RBAC: Adding query filter params (role.id=1197acedde154542b162281404f9b02c, user.id=2fb12de3fc1743eab8cd13120b89aa63, scope.system=all) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:40.788993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:40.790614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136c4db-8c5f-4561-b963-a03cf3bc6ccd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:40.801243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:40.808721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 172/334] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 22 16:52:40 2022] GET /identity/v3/role_assignments?user.id=2fb12de3fc1743eab8cd13120b89aa63&scope.system=all&role.id=1197acedde154542b162281404f9b02c => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:42.527825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c76e-8e8d-406f-accc-77f78bbedf9d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:42.528343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c76e-8e8d-406f-accc-77f78bbedf9d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:42.528418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676c76e-8e8d-406f-accc-77f78bbedf9d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:42.529975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 163/335] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:42.536619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c287-80ca-46e6-8593-2bdd7df634c8 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:42.537035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c287-80ca-46e6-8593-2bdd7df634c8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:42.537229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c287-80ca-46e6-8593-2bdd7df634c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:42.560144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2720c287-80ca-46e6-8593-2bdd7df634c8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:42.561321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2720c287-80ca-46e6-8593-2bdd7df634c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:42.655685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 173/336] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:42.723154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc62cb-a7f4-45f8-beda-8fc0b1e5a72c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:42.723484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc62cb-a7f4-45f8-beda-8fc0b1e5a72c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:42.723706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc62cb-a7f4-45f8-beda-8fc0b1e5a72c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:42.725047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 164/337] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:42.731916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:42.732429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:42.732904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:42.759668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:42.760869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:42.850226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 174/338] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:43.131240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc62cb-a7f4-45f8-beda-8fc0b1e5a72c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:43.237421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:43.260972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc62cb-a7f4-45f8-beda-8fc0b1e5a72c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:43.310574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:43.311260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.311547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.311820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.326367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:43.331216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:43.332131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:43.332941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 165/339] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:43.339184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:43.408086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:43.439716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:43.509737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d23b-73c6-4d1a-a228-b31e0a8f0d33 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:43.549547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:43.550223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.550464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.550729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.551415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] RBAC: Adding query filter params (name=member) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:43.551732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:43.553405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c245b-1f08-4c5a-a01c-06b8bbb3b8df None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:43.562116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 175/340] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:43.568003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f143b4-814c-4051-9ed6-ef7d0b43ea0d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.568288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f143b4-814c-4051-9ed6-ef7d0b43ea0d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.568562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f143b4-814c-4051-9ed6-ef7d0b43ea0d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.574679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 176/341] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:43.574679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f143b4-814c-4051-9ed6-ef7d0b43ea0d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:43.609038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bcbf9-4682-4711-b955-a35a56fddf26 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:43.671477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:43.672473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.673023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.673495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.687024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:43.689058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f143b4-814c-4051-9ed6-ef7d0b43ea0d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:43.692364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-39d47e18-9641-4d12-84e4-cb960283884a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:43.708254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:43.710105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:43.711571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:43.713679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 166/342] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:43.715155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.715617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.716038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.717704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:43.743736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:43.744606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:43.745029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:43.745441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:43.747747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:43.754677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:43.870943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:43.872415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93650f14-96be-4e86-a379-b205aa53b3a2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:43.877734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 167/343] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:43.878426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.014142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037688-ba6c-4f0b-9b10-5a082e8b6856 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.027719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 177/344] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:44.028981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687626b9-8d71-4226-a56a-ee2e1622a759 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.029269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687626b9-8d71-4226-a56a-ee2e1622a759 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.029556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687626b9-8d71-4226-a56a-ee2e1622a759 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.030883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 178/345] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:44.034350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687626b9-8d71-4226-a56a-ee2e1622a759 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.062896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.065582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.077381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.078005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.078288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.078562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.079264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:44.079568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.080939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc0b11-49fe-47af-a597-1144d34a299f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.090030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 168/346] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:44.093146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.093432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.093703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.129596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:44.130840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:44.212749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687626b9-8d71-4226-a56a-ee2e1622a759 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.265757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.266321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.266601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.267181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.268949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 169/347] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:44.269621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.271228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.271696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.273682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 179/348] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:44.274451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.408353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c9a5-6540-4fa1-9717-b69b06c3ff7f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.410344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538dacf-d299-425d-8fd0-d6fc3a4de7d1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.410842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.438380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.452675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.453290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.453576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.453845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.454418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.455260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.455686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.456103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.467819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:44.473806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:44.474982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 16:52:44.476588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:44.478645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 180/349] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:44.482476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.532424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.533811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.648379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acb27e-cc10-44ef-89d9-2c968a1525b0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.651493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 170/350] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:44.652793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.686154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.689878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.691358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.691827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.692469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.699551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.701338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.708201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 181/351] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:44.709212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.731079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:44.781986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be0e9c-af0e-411d-a62b-71fc1d757585 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.831494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.832185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.832543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.832888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.833732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:44.834119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.836581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.846613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632ca4f-f4ac-4802-be04-e9158c804460 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:44.852179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 171/352] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:44.852179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.898358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:44.899275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:44.899629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:44.899975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:44.901231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:44.904119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:44.906205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 182/353] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:44.907090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:44.980984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.002459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6640d9c-e5c4-4ffd-b685-2420765a4fb5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.018173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.041941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6940a2-1112-4b25-9e0d-bffaf2b99486 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.051026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.051756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.052110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.055401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.070718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:45.077194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:45.078086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:45.078940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 172/354] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:45.080386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.084554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.085433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.085715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.085989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.087520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=1197acedde154542b162281404f9b02c, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:45.087520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.088510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.096441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 183/355] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:44 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=1197acedde154542b162281404f9b02c => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.097102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.223977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f7c4-6482-4855-bfbf-0041e93390e3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.252921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8930e84-87a0-4ba2-b00a-d55421fc7d72 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.281347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.282006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.282293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.282567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] PATH_INFO: `/v3/users/cda61fba945e449d86307dc34208e50e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.285929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cda61fba945e449d86307dc34208e50e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.289707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16256a8-e9d5-4e56-8808-ced3425059d4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.292813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 173/356] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/users/cda61fba945e449d86307dc34208e50e => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.294805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba18c3-316b-4926-b37e-49403f1c883d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.297356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba18c3-316b-4926-b37e-49403f1c883d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.297952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba18c3-316b-4926-b37e-49403f1c883d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.299679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 174/357] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:45.300991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba18c3-316b-4926-b37e-49403f1c883d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.309488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.310510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.311033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.311524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.313117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.315781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.317744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 184/358] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.318925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.322548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.343771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.433213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba18c3-316b-4926-b37e-49403f1c883d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.456201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88f864-7a39-427e-878f-86b5dba5a0c0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.477489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.478118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.478402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.478733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.479394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:45.479701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.481074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7f71-0ca4-43b7-9547-e6560b38a427 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.492073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 175/359] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.493250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d056-9929-4e8e-a2a0-1fccb74bf567 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.493536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d056-9929-4e8e-a2a0-1fccb74bf567 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.493810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d056-9929-4e8e-a2a0-1fccb74bf567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.496318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.497034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.497313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.497583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.498312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] RBAC: Adding query filter params (role.id=fc092d43359d4c499a73ea3a6be74b2b, user.id=cda61fba945e449d86307dc34208e50e, scope.system=all) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:45.498674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.500409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.515081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0285d056-9929-4e8e-a2a0-1fccb74bf567 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:45.515999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 185/360] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/role_assignments?user.id=cda61fba945e449d86307dc34208e50e&scope.system=all&role.id=fc092d43359d4c499a73ea3a6be74b2b => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.516270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0285d056-9929-4e8e-a2a0-1fccb74bf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:45.517246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.605498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 176/361] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:45.606838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a5a2-cb93-4f3a-bea1-409e8c749295 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.607127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a5a2-cb93-4f3a-bea1-409e8c749295 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.607465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a5a2-cb93-4f3a-bea1-409e8c749295 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.608974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 177/362] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:45.609682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a5a2-cb93-4f3a-bea1-409e8c749295 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:45.616018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.621618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.661845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1684b1-908e-4479-8138-0d5c0c10c1ae None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.748885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a5a2-cb93-4f3a-bea1-409e8c749295 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:45.755259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.756053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.756350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.756628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.757927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:45.758238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.759751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c443a37-adf3-4eb2-b64c-5c2837a21a39 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.778227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 186/363] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:45.779562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.779803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.780081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.808335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:45.809310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:45.809788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:45.810772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:45.817240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:45.818500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:45.948763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:45.950319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 187/364] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:45.951777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:45.955009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:45.962550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.060663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.115297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 178/365] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:46.121588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.126829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f188f1-dc7a-4c7d-a4ed-5bc9e1a9fa0a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.198731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.199436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.199668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.199940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.220502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:46.227677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:46.228581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:46.229404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:46.230033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 188/366] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:46.236162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.318147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975751a-de90-45e3-b68d-0afb513b3c32 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.321042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.360168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.361169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.361653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.362159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.366713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:46.368056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:46.374029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 179/367] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:46.374029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.403185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d0726-ac77-44b7-a503-612528f1b787 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.466348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.470004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.470721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.471088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.471946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.472878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:46.473440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:46.475371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:46.486162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 189/368] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:46.487232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.505772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976148-682e-41a8-ae9a-6055a0535c1d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.559248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.560009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.560594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.560733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.574223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:46.579445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:46.580752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 180/369] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:46.587778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.622328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0bee-7833-48bd-9ab0-360d6f56068a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.629522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.662511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.664803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.665308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.665797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.667198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:46.668994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:46.670856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 190/370] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:46.671822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.704140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d437e9f-22fa-4b27-a0e3-d8f941fbc42b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.745106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.745707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.745991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.746265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.748203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.812169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a4462-c0f9-47aa-83de-ce86f78e222e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:46.831111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:46.832595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:46.860805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:46.861030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:46.861242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:46.861468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:46.862137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:46.862442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:46.863849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:46.875657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 191/371] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:46.876307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:46.890992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:46.993212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 181/372] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:46.995077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.035003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c788fa-2d83-4d68-8b5b-39b978e3da6a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.053050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.073113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.073903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.074353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.074733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.075593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=1197acedde154542b162281404f9b02c, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:47.075974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.077716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.083795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 192/373] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=1197acedde154542b162281404f9b02c => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.084593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.158062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43735aaf-06f7-4140-954d-0b9e167f662a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.227253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.237596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.238229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.238511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.238833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.307306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57523b99-bc68-450e-bf18-6de268689247 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.348824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.351430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.357555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.358495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.359061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.359614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.363390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.365075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.367795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 193/374] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.372825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.452190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.457354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 182/375] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:47.463664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.508501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.516708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fd2c5-794a-4222-aa13-222bfeecdbe8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.557559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.559220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.559742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.560539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.561900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.564155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.566374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 194/376] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.575642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.609525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e08ef-d73b-4f2c-bc16-0f58b87eb701 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.655163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.655815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.656101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.656375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] PATH_INFO: `/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.659248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] RBAC: Authorizing `identity:get_project(project_id=fea30cfd8ebb4269b38aaa42ab5d2d7a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.660695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.662506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 183/377] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.668546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:47.768366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8250117-fa3b-45a2-9918-0267897bca9f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.815863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.848777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.849863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.850219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.850694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.851744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:47.852400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.854151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3105fe-c4e4-4c4b-a276-6632dc7c836d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.860270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:47.863828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 195/378] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.864538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f0637-0d20-4cc0-b3e6-512754f1b867 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:47.865266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ece52-b829-4ce3-8e41-c2559f531cdd None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.865669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ece52-b829-4ce3-8e41-c2559f531cdd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.870685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ece52-b829-4ce3-8e41-c2559f531cdd None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.870685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 196/379] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:47.876535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.876814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.877096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.922019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:47.923289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:47.949434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:47.950087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:47.950366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:47.950640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] PATH_INFO: `/v3/groups/0ccc53108c004f8abae3d51917c6b3d3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:47.964305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] RBAC: Authorizing `identity:get_group(group_id=0ccc53108c004f8abae3d51917c6b3d3)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:47.965811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:47.967586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 184/380] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/groups/0ccc53108c004f8abae3d51917c6b3d3 => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:47.974329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:48.031211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 197/381] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:48.159736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460553e3-f422-4b39-935b-0f8b7e16fe9a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:48.205271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:48.206142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:48.206595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:48.207037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:48.207943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] RBAC: Adding query filter params (group.id=0ccc53108c004f8abae3d51917c6b3d3, role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=fea30cfd8ebb4269b38aaa42ab5d2d7a) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:48.208409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:48.210129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:48.218355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 185/382] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:47 2022] GET /identity/v3/role_assignments?group.id=0ccc53108c004f8abae3d51917c6b3d3&scope.project.id=fea30cfd8ebb4269b38aaa42ab5d2d7a&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:48.342504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:48.477682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f17e8-bf0e-4de1-a8c3-a0f3473cd701 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:48.493499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:48.518156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:48.518827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:48.519108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:48.519375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:48.530795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-f56ee8c4-2b3a-42fd-959b-02a3799e6547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:48.535534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:48.536494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:48.537306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:48.541546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 198/383] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:48.544214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:48.550871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ab6-89cb-4681-9c0c-656f22681a43 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:48.551384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ab6-89cb-4681-9c0c-656f22681a43 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:48.551658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15ab6-89cb-4681-9c0c-656f22681a43 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:48.553651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 199/384] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:48.560429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239045f-f261-4243-9561-42814e18a12b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:48.560721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239045f-f261-4243-9561-42814e18a12b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:48.560995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239045f-f261-4243-9561-42814e18a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:48.580508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1239045f-f261-4243-9561-42814e18a12b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:48.581701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1239045f-f261-4243-9561-42814e18a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:48.604263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:48.700317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 200/385] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:48.744998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9aa76-254a-4800-8ee4-5b7771b8f8ef None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:48.788811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:48.789440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:48.789714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:48.789985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:48.790670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:48.790984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:48.792362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:48.806184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 186/386] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:48.811924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239045f-f261-4243-9561-42814e18a12b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:48.966993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239045f-f261-4243-9561-42814e18a12b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:48.968902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:49.017552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.018115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.018393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.018685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.019801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.021248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.023224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 201/387] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:48 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:49.029444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.039696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.142232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:49.155701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f076-ea6e-4df1-bba6-733cf87ddef0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.195686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.196777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.197252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.197727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.199082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.201146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.208344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 187/388] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:49 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:49.210583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.261703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455d946-d70a-4a17-8e5e-2a7e2cbe99b5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.324935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb0fc6-7835-449d-8f3f-31bef523f159 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.342433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.343122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.343409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.343685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.364012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.365047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.365528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.365997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/groups/da8346e63caf4603bf87a109a81a4c18/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.369181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, group_id=da8346e63caf4603bf87a109a81a4c18, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.370865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.371624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:49.376706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:49.378579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:49.380133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 202/389] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:49.384255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.392640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 188/390] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 22 16:52:49 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/groups/da8346e63caf4603bf87a109a81a4c18/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:49.441302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:49.532623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb808c-fe58-4735-b5b1-861fb41c9404 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.583106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.583641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.583924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.585782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.585782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:49.585782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.586616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.598618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 203/391] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:49.604468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.625558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:49.722001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66090d-6552-4bb6-8e39-cd4ca61e9abf None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.759669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.760821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.761304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.761784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.763102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.764732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.766842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 189/392] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:49 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:49.775968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.881893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:49.895272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041cb1c-53ca-45ea-b368-38ad203b245a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:49.936045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:49.937021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.937514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.937991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.939466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:49.941098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382193e-9977-4c08-9c77-23b27f940149 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:49.945734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 204/393] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:49 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:49.951176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:49.974913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465012c-4fb3-416b-b9b6-55aae0247ebf None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.975654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465012c-4fb3-416b-b9b6-55aae0247ebf None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.977547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465012c-4fb3-416b-b9b6-55aae0247ebf None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:49.979560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 205/394] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:52:49.989361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:49.990168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:49.990634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:50.013602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:50.015258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:50.105038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 206/395] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:50.133407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:50.155615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32c2a-44c1-4f10-a823-e56f10b41bd2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:50.205743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:50.206414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:50.206710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:50.207047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/groups/da8346e63caf4603bf87a109a81a4c18/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:50.209154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] RBAC: Authorizing `identity:create_grant(project_id=6c592d1e6e8f4e70927f0b223a28c5ff, group_id=da8346e63caf4603bf87a109a81a4c18, role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:50.211180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:50.232187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 190/396] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 22 16:52:49 2022] PUT /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff/groups/da8346e63caf4603bf87a109a81a4c18/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:52:50.444410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:50.549503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:50.560398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee1ff-ce48-4974-ae68-6a832eead740 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:50.597914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:50.598959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:50.599440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:50.599946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:50.611257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:50.617149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:50.618049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:50.618906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:50.621238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 207/397] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:50.627295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:50.739799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086de0a-2c4b-4ada-8dad-2806fcfd4ebc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:50.777757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:50.778841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:50.779325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:50.779817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:50.780696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:50.781210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:50.782815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:50.792117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 191/398] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:50.797953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:50.924887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9cc47-7e03-4db9-8230-f972a2fd182d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:50.964820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:50.965818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:50.966316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:50.966818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:50.968138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:50.969798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:50.971658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 208/399] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:50 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:50.977691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:50.995372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:51.127837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0186e-8827-446f-93f1-e65548ce4197 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:51.177655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:51.178321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.178579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.179115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.180466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:51.181968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787047fa-b43b-42a1-8897-37849408ed4f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:51.183811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 192/400] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:50 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:51.189975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:51.217726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:51.313558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa76a5-6cdc-4d37-a421-4e81f1cd5aeb None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.313749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa76a5-6cdc-4d37-a421-4e81f1cd5aeb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.314019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa76a5-6cdc-4d37-a421-4e81f1cd5aeb None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.315408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 193/401] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:51.320254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949748-5131-48d0-9ab9-fd7fd56a434c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.320536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949748-5131-48d0-9ab9-fd7fd56a434c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.321010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949748-5131-48d0-9ab9-fd7fd56a434c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.322523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 194/402] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:51.323595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.323877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.324150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.337539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f906cc-5edd-497e-a990-c92f4b46f1c3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:51.351434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:51.353238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:51.375387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:51.376397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.376899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.377438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/groups/da8346e63caf4603bf87a109a81a4c18/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.379777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, group_id=da8346e63caf4603bf87a109a81a4c18, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:51.381660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace40a6-ccda-4ef6-b2cf-522295940d9f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:51.400197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 209/403] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 22 16:52:51 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/groups/da8346e63caf4603bf87a109a81a4c18/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:51.407592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.408311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.408860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.427728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 195/404] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:51.444072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:51.445815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:51.565038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 210/405] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:51.712878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:51.721147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:51.825888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f422-02b3-4a24-8c70-f411dcd85320 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:51.861959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:51.862605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:51.862921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:51.863198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:51.874559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:51.879663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:51.880546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:51.881370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 196/406] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:51.891783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:51.909495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:51.925295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.025331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:52.061296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b4907-6ff5-4e73-887f-d9c8894413d1 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.098932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.099897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.100496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.101172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.112698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:52.117451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a882fb4-f0d4-46a7-b068-9f7e8dd7f60b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:52.119414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:52.120315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:52.121125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:52.126768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 197/407] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:52.129767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.188742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.189361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.189648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.189922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.190600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:52.190930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.192528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.211036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 211/408] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:52.216882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.241226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a8502-d503-4bb9-ab5c-f732e326dc1b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.301090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:52.312879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:52.333199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.336127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.336985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.338223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.339179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:52.339928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.342439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.367332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 198/409] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:52.371498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.386548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef052f-b78e-4f4e-8243-d188410cbab4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.442473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.442473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.442473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.442473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.442923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.442923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d6cee-246e-4caf-a136-e525cf8db231 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.443752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 212/410] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:52 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:52.457123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7b42-a28c-4ff4-8b3b-50a865cd602c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.457409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7b42-a28c-4ff4-8b3b-50a865cd602c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.457673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7b42-a28c-4ff4-8b3b-50a865cd602c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.459253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 213/411] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:52.459943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f7b42-a28c-4ff4-8b3b-50a865cd602c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.529301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a1b61-3d1e-40bf-b378-8049438bede7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.574265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.574933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.575212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.575484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] PATH_INFO: `/v3/groups/0ccc53108c004f8abae3d51917c6b3d3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.576610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] RBAC: Authorizing `identity:get_group(group_id=0ccc53108c004f8abae3d51917c6b3d3)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.578984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9d7c4-da9f-40e9-8d26-0ca4bb0fec23 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.580870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 199/412] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:52 2022] GET /identity/v3/groups/0ccc53108c004f8abae3d51917c6b3d3 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:52.581352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f7b42-a28c-4ff4-8b3b-50a865cd602c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.582105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.582393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.582680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.603017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:52.604196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:52.623066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.623651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.623984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.624257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.625420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.626931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.634324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 214/413] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:52 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:52.635249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.644922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:52.668736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:52.691323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 200/414] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:52.691960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.810455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e732d10-3957-4359-b727-306f979775f6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.864127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d698af-0a35-40f5-a2b9-fe61467ae692 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:52.880468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.881396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.882140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.884402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] PATH_INFO: `/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.885775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=fea30cfd8ebb4269b38aaa42ab5d2d7a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.887447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:52.889601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 215/415] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:52 2022] GET /identity/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:52.896621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:52.960342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:52.961132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:52.961416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:52.961691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/groups/da8346e63caf4603bf87a109a81a4c18/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:52.966929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4abdf7b3047719441dbaa03f8c416, group_id=da8346e63caf4603bf87a109a81a4c18, role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:52.968753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:53.000396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 201/416] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 22 16:52:52 2022] PUT /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416/groups/da8346e63caf4603bf87a109a81a4c18/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:52:53.001526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.017659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.060075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced596d-1646-4fb2-8f3e-bb3081023ad1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:53.083262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.105873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:53.106566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.106897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.107176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] PATH_INFO: `/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a/groups/0ccc53108c004f8abae3d51917c6b3d3/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.109333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea30cfd8ebb4269b38aaa42ab5d2d7a, group_id=0ccc53108c004f8abae3d51917c6b3d3, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:53.110928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6317b-d852-401b-b729-c538a96ee9e8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:53.126611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 216/417] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 22 16:52:52 2022] PUT /identity/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a/groups/0ccc53108c004f8abae3d51917c6b3d3/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:52:53.128582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6017-cff8-4640-8f5c-10afbf81fbc4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.128582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6017-cff8-4640-8f5c-10afbf81fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.128878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad6017-cff8-4640-8f5c-10afbf81fbc4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.135479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 217/418] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:53.136965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.137335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.137619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.162313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:53.164158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91137d-7599-487a-b523-ce205b0e9791 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:53.164299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:53.213695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:53.214771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.215253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.215724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.232206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:53.238048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:53.239290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:53.240128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:53.243136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 202/419] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:53.254117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.268385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 218/420] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:53.379946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40602e-a9ea-4f20-93c7-5b4f9c7ef0b0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:53.388247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.418685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:53.419365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.419652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.419926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.420596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:53.420903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:53.422351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:53.431234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 203/421] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:53.437103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.517247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.555587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.576850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162106e-67eb-4923-86a9-235e9a6d5297 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:53.631577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:53.632237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.632527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.632808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.731416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:53.733503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:53.738447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de85-7583-4e63-ab7e-78638477a345 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:53.806324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:53.806987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:53.807268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:53.807539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:53.827717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:53.832902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:53.833798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:53.834635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:53.836467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 204/422] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:53.841242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.841568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.894362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:53.922464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 219/423] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:53.937955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:53.984238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8c27-f780-4bbe-b502-a3504db64c54 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.033383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.033996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.034332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.034610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.035304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:54.035657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.037033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.054097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 205/424] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:54.059719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:54.104696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85fbcd-2b85-43cb-b6bd-084bc26e8602 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.171382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.172144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.172332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.172598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.173784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.175272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.177266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 220/425] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:53 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:54.187953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:54.212737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:54.224053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1539b-e92b-4f07-8302-f72a1e1e8918 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.260105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:54.269497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.270177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.270519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.270839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.346679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.348166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.418188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9555-eb4b-4d08-890b-f3f96a2274f3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.451058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:54.453827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.454647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.455114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.455536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.456819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.458511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff9406-ff84-476e-9b1a-7906175fbcf2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.461226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 221/426] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:54.462796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 206/427] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:52:54.463177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ded4-5f10-4ac7-b120-7be24fc2ca96 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.463470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ded4-5f10-4ac7-b120-7be24fc2ca96 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.463740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ded4-5f10-4ac7-b120-7be24fc2ca96 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.464973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 222/428] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:54.467713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:54.469853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ded4-5f10-4ac7-b120-7be24fc2ca96 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:54.579581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52950-3f91-4dd8-92d6-afefd6caf214 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.601054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:54.614259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ded4-5f10-4ac7-b120-7be24fc2ca96 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.627954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.628867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.629295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.629745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.630736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=1197acedde154542b162281404f9b02c, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:54.631194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.633791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228590b-143c-4ab1-8a37-180da522effc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.641922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 207/429] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=1197acedde154542b162281404f9b02c => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:54.643657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.644127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.644797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.660151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.660878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.661219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.661578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] PATH_INFO: `/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.662838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6c592d1e6e8f4e70927f0b223a28c5ff)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.664413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.667303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 223/430] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/projects/6c592d1e6e8f4e70927f0b223a28c5ff => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:54.671551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:54.672485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:54.673411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:54.737977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:54.761944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 208/431] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:52:54.877908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0aa60-563d-4eb7-a301-893a1419d5a6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:54.923720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:54.924354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:54.924636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:54.924909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:54.926024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:54.927498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:54.929498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 224/432] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:54.935454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:55.054234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b9a24-42b7-4bbe-a955-8eb93df09fe0 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:55.095783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:55.096403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.096691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.096966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.097709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:55.098076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:55.099573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:55.106233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 209/433] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:54 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=6c592d1e6e8f4e70927f0b223a28c5ff&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:55.129915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:55.181614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:55.267341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88db1-e5c3-41c0-aa76-6421c4099d38 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:55.308653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:55.309304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.309584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.309855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.325489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:55.330672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:55.331578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 16:52:55.332380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:55.332984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 225/434] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:55.338672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:55.407937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:55.472221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2d0f9-89f1-4ef4-9a3c-85ce41aeb34c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:55.513131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:55.513742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.514025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.514296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.514997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:55.515301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:55.516701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca7a7e-8c67-422d-9af9-5d9ba2a69de8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:55.531239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 210/435] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:55.533893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:55.643282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:55.651653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100f721-f6e0-4dda-a481-d719a7d120a3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:55.653888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1232ee-fb11-4190-a136-649ea5ca056c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.654176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1232ee-fb11-4190-a136-649ea5ca056c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.654451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1232ee-fb11-4190-a136-649ea5ca056c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.655834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 211/436] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:55.661818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b0ef-673d-476a-b5d3-83a0d68f40f3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.662091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b0ef-673d-476a-b5d3-83a0d68f40f3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.662311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b0ef-673d-476a-b5d3-83a0d68f40f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.685003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0192b0ef-673d-476a-b5d3-83a0d68f40f3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:55.686367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0192b0ef-673d-476a-b5d3-83a0d68f40f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:55.697238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:55.697878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.698162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.698435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.791853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:55.793256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 212/437] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:55.793705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:55.800207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e48ad-b92d-4f50-84f0-2d9f8edde694 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.800207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e48ad-b92d-4f50-84f0-2d9f8edde694 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.800207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e48ad-b92d-4f50-84f0-2d9f8edde694 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.801073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 213/438] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:52:55.807055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:55.807342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:55.807618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:55.827099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:52:55.828292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:52:55.865244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:55.903717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:55.914780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 214/439] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:52:55.915292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 226/440] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:52:55.916334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.022518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311b04c-0cb2-4744-a63e-ab40f0175a94 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.057402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.058033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.058317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.058594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.059741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.061171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.062818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 215/441] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:55 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:56.068350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.074791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.115671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.176908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2580e-ab0a-4fdc-ad40-95354eca3238 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.181302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecc4da-ae15-4e80-bbc5-f6fce74e647c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.212726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.213357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.213644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.213918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.215136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.216453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.216583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.217074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.217350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.217621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.218167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 227/442] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:56.218959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.229110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:56.233819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:56.234800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 216/443] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:52:56.235664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.282027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.318755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a6d0-ca8b-45c6-a70f-e934eadabec6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.332105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.336561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6af6a-61f3-4fa5-b469-e860670d61a0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.353232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.353864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.354148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.354423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.364346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:52:56.369822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:52:56.370750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:52:56.371566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 228/444] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:52:56.372376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.372376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.372860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.372930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.372930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.372930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=1197acedde154542b162281404f9b02c, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:56.373201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.374638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.383309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 217/445] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=1197acedde154542b162281404f9b02c => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:56.403006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.489785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6f61-260d-429e-93eb-c29cf3dae286 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.498483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3600ad-65d9-4501-a536-1eff788cf36c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.516202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.529777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.530404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.530704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.530987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.531674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:56.531984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.533399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.538264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.540000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.540296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.540593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.541280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:56.541591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.543129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 229/446] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:56.543267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.548805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.552587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 218/447] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:56.558419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.587408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.670473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdedc7-97fc-4726-a7ab-ebe2c36158c6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.683107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4f24e-7e16-4a80-b796-e490c658c98d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:56.714134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.714782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.715066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.715342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.724247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:56.725166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:56.725276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:56.725515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:56.778506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.792105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.793558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.806190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:56.807674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:56.831501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.895242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 230/448] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:52:56.896254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.910995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 219/449] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:52:56.911990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:56.981654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:56.997263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda665a1-d8d2-4b67-abec-aa723941921b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.013338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68b3d0-157f-466f-98c7-d4bdc02cac7e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.032360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.032914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.033198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.033468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] PATH_INFO: `/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.034571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] RBAC: Authorizing `identity:get_project(project_id=fea30cfd8ebb4269b38aaa42ab5d2d7a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.036039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.036451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:57.037658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 231/450] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/projects/fea30cfd8ebb4269b38aaa42ab5d2d7a => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:57.043400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:57.050787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.051691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.051691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.051938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] PATH_INFO: `/v3/projects/f2d4abdf7b3047719441dbaa03f8c416` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.053032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] RBAC: Authorizing `identity:get_project(project_id=f2d4abdf7b3047719441dbaa03f8c416)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.054673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.056273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 220/451] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:52:56 2022] GET /identity/v3/projects/f2d4abdf7b3047719441dbaa03f8c416 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:52:57.061699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:57.144088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bad8cd-943a-48a5-8a96-d3d3fcbaf6ad None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.160219 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8406-7df5-474a-87ac-722486cebae4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.178006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.178683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.178983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.179875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] PATH_INFO: `/v3/groups/0ccc53108c004f8abae3d51917c6b3d3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.180986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] RBAC: Authorizing `identity:get_group(group_id=0ccc53108c004f8abae3d51917c6b3d3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.182432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.184025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 232/452] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:57 2022] GET /identity/v3/groups/0ccc53108c004f8abae3d51917c6b3d3 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:57.189922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:57.195906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.196541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.196821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.197098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] PATH_INFO: `/v3/groups/da8346e63caf4603bf87a109a81a4c18` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.198212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] RBAC: Authorizing `identity:get_group(group_id=da8346e63caf4603bf87a109a81a4c18)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.199677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.201236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 221/453] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 22 16:52:57 2022] GET /identity/v3/groups/da8346e63caf4603bf87a109a81a4c18 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:57.206865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:52:57.213619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:57.264930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:52:57.290711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2ac7-8745-42be-8a0b-3ed9fe5c05a0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.306647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906eb23-33df-4aed-bb86-ccf13d07b200 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:52:57.324290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.325085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.325386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.325649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.326375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] RBAC: Adding query filter params (group.id=0ccc53108c004f8abae3d51917c6b3d3, role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=fea30cfd8ebb4269b38aaa42ab5d2d7a) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:57.326722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.328154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4d3a-2c22-43f7-9060-66c4e8063693 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.333836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 233/454] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:57 2022] GET /identity/v3/role_assignments?group.id=0ccc53108c004f8abae3d51917c6b3d3&scope.project.id=fea30cfd8ebb4269b38aaa42ab5d2d7a&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:52:57.340354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:52:57.340977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:52:57.341257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:52:57.341531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:52:57.342276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] RBAC: Adding query filter params (group.id=da8346e63caf4603bf87a109a81a4c18, role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=f2d4abdf7b3047719441dbaa03f8c416) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:52:57.342585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:52:57.344091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b50b1-c991-4895-951e-7976f8e42679 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:52:57.350763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 222/455] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 22 16:52:57 2022] GET /identity/v3/role_assignments?group.id=da8346e63caf4603bf87a109a81a4c18&scope.project.id=f2d4abdf7b3047719441dbaa03f8c416&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:00.177158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6971-0287-4ea5-8dbb-786679250255 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:00.177919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6971-0287-4ea5-8dbb-786679250255 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:00.178049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a6971-0287-4ea5-8dbb-786679250255 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:00.181016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 234/456] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:00.189289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308942-ff06-42df-a57e-ce38453cf220 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:00.190525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308942-ff06-42df-a57e-ce38453cf220 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:00.191513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a308942-ff06-42df-a57e-ce38453cf220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:00.230137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7a308942-ff06-42df-a57e-ce38453cf220 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:00.232580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7a308942-ff06-42df-a57e-ce38453cf220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:00.391288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 223/457] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:00.996512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6971-0287-4ea5-8dbb-786679250255 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.015341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1341f-008f-4ce0-a18d-d77525610ba1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.015618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1341f-008f-4ce0-a18d-d77525610ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.016175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1341f-008f-4ce0-a18d-d77525610ba1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.017929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 224/458] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:01.024129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e779-7d07-4504-93f3-ca34629e5535 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.024589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e779-7d07-4504-93f3-ca34629e5535 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.025053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e779-7d07-4504-93f3-ca34629e5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.058866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f894e779-7d07-4504-93f3-ca34629e5535 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:01.061275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f894e779-7d07-4504-93f3-ca34629e5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:01.123206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.127260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.142480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a6971-0287-4ea5-8dbb-786679250255 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.145821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 225/459] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:01.152147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294288-2b60-4d12-a1a0-5742eecafb23 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.152437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294288-2b60-4d12-a1a0-5742eecafb23 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.152708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93294288-2b60-4d12-a1a0-5742eecafb23 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.154413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 226/460] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:01.155747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c6eb-2f38-40db-9929-105be8f73854 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.156028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c6eb-2f38-40db-9929-105be8f73854 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.156299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5c6eb-2f38-40db-9929-105be8f73854 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.158182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 227/461] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:01.164563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.164849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.165122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.186512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.187838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.188344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.188879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.188994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:01.190293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:01.202296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:01.205958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-af5d4e59-e43d-4003-8690-f207c99b6ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:01.221791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:01.222801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:01.223686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:01.223686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.223686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:01.230859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 235/462] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:01.232536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.233021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.233512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.253601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:01.255139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:01.273700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 228/463] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:01.282961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.373091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 236/464] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:01.435272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.442249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a475-d13f-4b6e-af21-9f34c8009ee1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.467145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.512490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.512672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.513647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.514381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.515866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.516925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:01.517561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:01.520366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:01.547838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 229/465] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:01.557997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.567458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c3a0a-089e-41b8-a597-c90f3ff85f9d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.634343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.635392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.635891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.636361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.648944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:01.651090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:01.669464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:01.670423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:01.671350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:01.671350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.671350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:01.673515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 237/466] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:01.674613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.710226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e405f0e-350e-4667-90af-d2247f56bae7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.749641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.751745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.752259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.752733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.753602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:01.755322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:01.783429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 230/467] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:01 2022] POST /identity/v3/users => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:01.784521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.785116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c7054-0905-48b4-b4c7-6b3430b1907a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.814032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.826556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:01.841336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.842067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.842358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.842634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.856258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:01.857772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:01.873679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:01.874715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:01.875591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:01.875591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:01.875591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:01.879966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 238/468] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:01.880914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:01.940509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9635f64-95d7-4af9-881d-4b6556fda630 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:01.994629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:01.995320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:01.995603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:01.995878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:01.996546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:01.996855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.000156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.016432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 231/469] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:02.017167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.022459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c53b4-f93d-4137-a475-030efda948ca None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.071516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.072119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.072351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.072642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.086027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.087584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:02.106499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:02.107540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:02.108441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:02.108441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:02.108441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:02.108441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 239/470] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:02.109296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.130268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:02.140431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:02.143503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f229-9160-4224-9cdc-544f76434aa4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.186996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.187603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.188545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.188545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.188814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:02.189107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.190489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.203239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 232/471] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:02.204068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.227275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f0ef-5872-4926-b74a-12dc1b87f8df None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.266880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.267488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.267774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.268131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.268755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.270208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d5f98-2a54-4d9c-b34d-f5870702abdd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.295788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 240/472] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:02 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:02.297429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff93-9a0a-4500-9009-07cfac08b113 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.297954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff93-9a0a-4500-9009-07cfac08b113 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.298482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff93-9a0a-4500-9009-07cfac08b113 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.304418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 241/473] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:02.305698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fff93-9a0a-4500-9009-07cfac08b113 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.320830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf053beb-7ede-41af-b382-ba1159064dac None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.369315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.369958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.370245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.370525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.372017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:02.372340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.374113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd37e5d-0512-4cc1-b49a-32759e8f5080 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.391492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 233/474] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:02.397623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.398475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.399007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.409473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:02.430499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:02.432205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:02.435493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fff93-9a0a-4500-9009-07cfac08b113 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.436178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:02.476778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.477467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.477766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.478046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.478752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.480223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.512504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 242/475] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:02 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:02.515680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.540740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 234/476] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:02.646156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8817da-3df3-4ba4-b584-db4fa47f6026 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:02.689740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:02.690393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:02.690711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:02.691040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:02.691708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:02.693253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:02.703348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:02.721508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 243/477] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:02 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:02.869534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:02.989709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4a996-b9ad-4385-875f-754517ba5e1e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:03.026987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:03.027613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:03.027893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:03.028487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:03.029175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:03.030552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:03.039293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.sql.core [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 16:53:03.039293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 16:53:03.039293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [parameters: {'id': '0020ea38797544fca0d77e8894b6041c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 16:53:03.039293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81529) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:53:03.056478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:53:03.058568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application yield resource Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise self.value Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application session.commit() Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 16:53:03.060832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.flush() Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application compat.raise_( Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 16:53:03.067235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:53:03.069349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:53:03.071921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [parameters: {'id': '0020ea38797544fca0d77e8894b6041c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:03.073241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 16:53:03.074237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:03.075357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 235/478] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 22 16:53:02 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:03.075436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:03.191423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbc881-9d60-4fb6-8376-faebd8f706ee None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:03.230352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:03.231012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:03.231288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:03.231562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:03.242525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-263b5717-7e73-4803-ae4d-006d5065627c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:03.247970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:03.250010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:03.251997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 244/479] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:03.255124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:03.263643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:03.408198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc60a-b5c3-4d70-af90-6e0f36cf5b5b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:03.456297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:03.456930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:03.457210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:03.457486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:03.458159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:03.458463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:03.459880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aecc6-26ca-4536-b0b5-4cce6d786dbf None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:03.470058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 236/480] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:04.314123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89906f5-d22e-45f4-b032-1782fcfa9008 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:04.314613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89906f5-d22e-45f4-b032-1782fcfa9008 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:04.314613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89906f5-d22e-45f4-b032-1782fcfa9008 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:04.316218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 245/481] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:04.321499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:04.321912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:04.322116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:04.343395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:04.344641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:04.412170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:04.421607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 237/482] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:04.840037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89906f5-d22e-45f4-b032-1782fcfa9008 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:04.896621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:04.961608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89906f5-d22e-45f4-b032-1782fcfa9008 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.012754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:05.013402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.013687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.013966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.026668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-dc14a9e0-2899-4363-8a80-b4032eb0e91b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:05.031931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:05.032854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:05.034059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 246/483] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:05.039375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.162562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787975b-56ab-4e44-800b-f0f6453ffd68 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.199856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dca64-c3a8-44a3-bb5e-d09ab2734866 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.200150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dca64-c3a8-44a3-bb5e-d09ab2734866 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.200432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dca64-c3a8-44a3-bb5e-d09ab2734866 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.202131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 247/484] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:05.205193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:05.205961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.206403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.206854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.207663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:05.208143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:05.208844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b5ef-7230-4af3-9c95-d098d83e59bf None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.209134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b5ef-7230-4af3-9c95-d098d83e59bf None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.209416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605b5ef-7230-4af3-9c95-d098d83e59bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.210222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:05.219623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 238/485] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:05.228476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.246743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b605b5ef-7230-4af3-9c95-d098d83e59bf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:05.247937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b605b5ef-7230-4af3-9c95-d098d83e59bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:05.342557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:05.384591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 248/486] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:05.401230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b423-d1d1-4c3e-ad81-44765241ae64 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.434903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf5fb-b358-485f-a6fa-d9ab1f32c4f4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.435093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf5fb-b358-485f-a6fa-d9ab1f32c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.435376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcf5fb-b358-485f-a6fa-d9ab1f32c4f4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.436960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 249/487] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:05.437818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:05.438608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.438932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.439208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.441945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b75741-9438-451d-96a9-b81030c088ca None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.442231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b75741-9438-451d-96a9-b81030c088ca None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.442510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b75741-9438-451d-96a9-b81030c088ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.451845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:05.453617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:05.477528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:05.478514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:05.479433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:05.479433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:05.479433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:05.481591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 239/488] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:05.486618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d9b75741-9438-451d-96a9-b81030c088ca None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:05.487518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.487826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d9b75741-9438-451d-96a9-b81030c088ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:05.567036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:05.612798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 250/489] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:05.654155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906477f-4407-4496-aa9a-df4edaf937ec None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.666098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:05.686716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddfc9-943b-47aa-8b68-bbd79286774e None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.686972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddfc9-943b-47aa-8b68-bbd79286774e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.687218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddfc9-943b-47aa-8b68-bbd79286774e None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.688557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 251/490] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:05.701987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.702279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.702559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.703711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:05.704325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.704600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.704870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.705512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:05.705814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:05.707202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:05.720667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 240/491] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:05.730747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:05.731625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.732026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:05.831237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 252/492] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:05.833909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.892873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810081-90b9-4dcc-9dde-3b7d8916fef3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.938429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:05.939062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:05.939349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:05.939627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:05.947180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:05.948624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:05.962600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:05.963569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:05.964523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 241/493] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:05.965111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:05.989764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e02c-653e-4c74-88d0-8a40aba04997 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:05.992105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.005063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.043126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.043864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.044149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.044526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.055876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:06.060895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:06.061786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:06.062618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 253/494] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:06.067520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.086644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8d104-6934-4d8e-9c49-716d37d99a6f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.123260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.123898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.124178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.124452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.136526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:06.142307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:06.144512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 242/495] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:06.146711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.175498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25718f31-3340-49c9-ade8-1a34d1193cc1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.213838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.214358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.214638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.214946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.215677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:06.215986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.217458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.247083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.256246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 254/496] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:06.260935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.261042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bfbf-4d76-4ae9-b678-e53717723c7c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.282391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.298585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.299377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.299666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.299943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.300608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:06.300911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.302452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.318646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 243/497] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:06.319529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.365187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f6909-8dee-460b-af06-b1ab5135cfb3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.401356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.402891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.403328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.404006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.404884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:06.405367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.406849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.419390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 255/498] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:06.419927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.434426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce8c69-6f41-4000-ae8f-64dbf6716d13 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.475950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.477113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.477339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.477615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.490404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:06.496237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:06.497158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 244/499] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:06.498912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.514601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.519190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.538200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bec17-2e3d-4fd0-b64a-f67b8c2d425a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.573453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.574048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.574328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.574598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.603487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafa9b2-5bc3-42f6-a550-9deaef92cc4c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.637402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.638025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.638308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.638589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.641457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.643104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.649603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.651064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:06.665349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:06.666412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:06.667371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:06.667371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:06.667371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:06.667371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 245/500] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:06.667770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.729615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.730852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.748519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 256/501] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:06.749528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.774864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77965d04-816f-4bf7-aa78-47c42345ec4f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.808543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.809166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.809447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.809723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.821533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.823018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d8d5149f-a386-4faf-967a-db8b9721afc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:06.838562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:06.839696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:06.840778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:06.840778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:06.840778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:06.840778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 246/502] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:06.841043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c00f-41b2-4bd7-8e5b-6c160fc535a7 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.841230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c00f-41b2-4bd7-8e5b-6c160fc535a7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.841501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349c00f-41b2-4bd7-8e5b-6c160fc535a7 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.842721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 247/503] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:06.843454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349c00f-41b2-4bd7-8e5b-6c160fc535a7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.853413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06629e64-c11a-4a35-9192-313f8ed8e82d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.887606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.888210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.888496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.888771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.889431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:06.889735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.891131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:06.899807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 257/504] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:06.900601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:06.944566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.950669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349c00f-41b2-4bd7-8e5b-6c160fc535a7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:06.967356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:06.986034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:06.986647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:06.986953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:06.987228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:06.987874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:06.988181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:06.989580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.002727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 248/505] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.003528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.004967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcc809-3991-4338-ad3e-562622e2c996 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.038583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.039995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.040279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.040552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.051906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.053366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-38254982-5223-42ef-9d8d-e14552469a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:07.068059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.069145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:07.070373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:07.070373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.070373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:07.070373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 258/506] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.070939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.070939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.071154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.092269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:07.093483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:07.108318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4655d-864e-4969-9bec-d8203bb32261 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.141603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.142209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.142490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.142803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.143440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:07.143747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.145149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.157267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 249/507] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.158054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.169005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 259/508] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:07.169005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.187476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.208930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.265192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05572e-cc18-4a3d-9842-d3a3a0894a6e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.281927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8d13-baed-44e5-97c3-98ae017d917a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.303718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.304847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.305227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.305599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.312561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.314006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.317535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.318164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.318445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.318746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:07.327977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.328900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 260/509] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.329837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.334417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.336411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:07.351427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.352361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:07.353225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:07.353225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.353225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:07.353225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 250/510] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.354036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.426641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.442228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6a55a-46ed-419d-9710-6c1408fda5ea None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.451482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.463943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af16b72-03d2-4c2d-b0cb-a93ebfa46be8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.477515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.478227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.478584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.478970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.479623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:07.479933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.481323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.498040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.498930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.499035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 261/511] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.499130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.499237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.499556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.509223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.510648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:07.522118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.523292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 251/512] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.524610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.600936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd187-0e01-4d9e-84ee-a8b4c9a63c1e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.623883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f0e7-1999-4740-b407-17274328d7b6 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.634972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.635569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.635845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.636115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.636836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:07.637137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.638559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.656380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 262/513] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.657192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.660481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.662910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.663536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.664316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.664586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.665234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:07.665542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.667033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.679004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 252/514] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.679835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.691827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.755515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff015b52-72b3-44ff-8e68-a732aaec4d2b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.785450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb0d2-8db3-4006-8d1b-a1cf1be7a55c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.790004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.790634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.790946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.791225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.801423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.802904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:07.817352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.822896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:07.824036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:07.824036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:07.824036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:07.824036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 263/515] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.824036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.824370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.824370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.824370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.824370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.831087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.832533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:07.844078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:07.845105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:07.846275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:07.849818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 253/516] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:07.850588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.878296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.918162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:07.922063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d03c2-e88d-4a8c-8f3f-70244dc93e66 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.951618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267306-64a1-4282-8b6f-51d4d9dcca1f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:07.954621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.955248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.955525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.955794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:07.956509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:07.956809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:07.958249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:07.976470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 264/517] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:07.977401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:07.990050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:07.990675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:07.990972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:07.991245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.059619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.060996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.079462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25b9a-1c8d-4cc2-93e9-6017dc2fe956 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.093803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.114678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.115317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.115601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.115874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.124081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.125566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.134841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:08.137663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:08.138825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 265/518] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:08.139941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.174515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 254/519] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:08.175395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.243144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5de2-e0d4-47fd-84e3-d4c17a8e6f7f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.271396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3852c6-917e-415e-87ed-eed69f4ac4a2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.276028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.276628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.276906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.277175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.277810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:08.278111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.279777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.291423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 266/520] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:08.292202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.309858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.310482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.310868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.311218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.311972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:08.312356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.313773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.324679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.332165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 255/521] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:08.332991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.361213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.391067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6174838-5b2d-49f5-b108-94ccbb41e6d6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.424313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.424912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.425191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.425471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.435167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e225c-3068-49da-86b6-05c39b62f8e3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.472053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.473053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.473402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.473672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.474399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:08.474723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.476596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.492458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.494027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.516429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 256/522] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:08.517259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.526734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.593284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 267/523] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:08.594020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.605269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.620541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61f66-aef7-4884-8980-5d3b5e927a1e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.655503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.656132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.656412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.656683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.667227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.668702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:08.684159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:08.685089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:08.685961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:08.685961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:08.685961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:08.685961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 257/524] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:08.686176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.696371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a03-caf9-4e3f-b7e2-8111ac9ee3ba None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.729545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.730143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.730421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.730720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.731367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.732797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.740590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.754029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 268/525] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:08 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:08.754743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.796668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d723d-361e-4322-8e70-6340296d0207 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.838811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.839643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.839775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.840326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:08.840727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:08.841039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:08.842534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:08.857910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 258/526] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:08.866810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:08.870515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:08.911799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4102-b5ab-4a9f-94b2-abf215e93a48 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:08.967894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:08.968535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:08.968819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:08.969098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.009629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d244-b2e2-4eaf-b623-d9022b332230 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.049507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.055192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.055843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.056128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.056401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.058687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.060486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.069158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.071565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:09.087387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:09.088639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:09.089674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:09.089674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:09.089674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:09.091373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 259/527] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:09.092347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.153241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.179676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 269/528] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:09.180809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.213280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1a262-01d2-45fc-a2fa-120d91774fc1 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.261854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.262945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.264067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.265852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.269235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:09.270224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.272281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.286395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.289692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 260/529] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:09.291707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.298080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787542d-1d21-4e43-ba40-b32cd11e9a09 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.335498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.336175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.336543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.336728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.337377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:09.337680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.339089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.352704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 270/530] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:09.353745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.412384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c6071-1132-48de-bd64-b202969cfd7c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.429082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.451137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.451772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.452053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.452326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.464279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.465826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:09.482084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:09.488329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:09.489201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:09.489201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:09.489201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:09.489201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 261/531] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:09.489201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.497342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731ac1-b110-4711-ac06-a6a80d2dde3b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.547665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.548655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.549382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.550265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.560823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.563524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:09.581372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:09.582298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:09.583200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:09.584369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 271/532] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:09.584890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.602214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20351b-3cfc-438f-9167-05d54dd01e3f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.605027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.641351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.642839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.643522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.644525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.655965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.658215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:09.674461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:09.675383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:09.676262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:09.679311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 262/533] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:09.680854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.714688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.718032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2cc36-e60c-488f-9f76-147a4c8f8447 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.758165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.760004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.760443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.760866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.761664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:09.762197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.763769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.780650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 272/534] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:09.782216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.794012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf173a-8e8b-4f8b-94d3-832e67ccbab7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.837621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.838589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.839050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.839527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.840612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:09.841082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.842808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.859065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 263/535] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:09.860354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:09.872283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.915648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca9b9-8e77-4634-80cf-e91489fd18c7 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:09.958729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:09.964902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:09.965944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:09.966419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:09.967108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:09.968405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:09.969103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:09.971422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:09.979635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7040-1892-4207-ad71-4bcbe3fe3e62 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:10.009484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 273/536] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:10.009484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:10.025609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:10.026453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:10.026974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:10.027420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:10.037656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:10.039590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:10.053929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:10.055130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:10.056199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:10.058261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 264/537] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:10.059345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:10.140927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c42301-39f3-4b37-a399-6d54d0c1e392 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:10.175723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:10.180644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29dad-11a2-4bfa-995a-5f78aa8eb072 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:10.185419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:10.186236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:10.186727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:10.187149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:10.188027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=d137d89c725440d290a2d63c4c9c67f3) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:10.188485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:10.190524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:10.197961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 274/538] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:10 2022] GET /identity/v3/role_assignments?user.id=d137d89c725440d290a2d63c4c9c67f3&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:10.199152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:10.220118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:10.220824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:10.221232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:10.221614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:10.222485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=72ddabdd350b45c68233ea757a6aec54) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:10.223007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:10.224600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:10.243175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 265/539] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:10 2022] GET /identity/v3/role_assignments?user.id=72ddabdd350b45c68233ea757a6aec54&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:10.342515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb574a-925b-4227-a5f7-86905f121a38 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:10.383270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:10.384168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:10.384601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:10.385122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:10.386000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:10.386468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:10.388181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c5f14-a32f-4277-b24e-b28f71e6ef96 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:10.404324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 275/540] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:10.409858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:10.435767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:10.557510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ece13f-86f6-4dd6-9eab-77956875328c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:10.600117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:10.600727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:10.601004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:10.601850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:10.602682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=997ef7cf46b345d0ab4085d3419cac44) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:10.603007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:10.604444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d5bcc-9896-4775-be09-81b6727e169d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:10.612346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 266/541] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:10 2022] GET /identity/v3/role_assignments?user.id=997ef7cf46b345d0ab4085d3419cac44&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:11.298428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd634-14c5-48b1-ab6f-f141074452db None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:11.299457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd634-14c5-48b1-ab6f-f141074452db None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:11.299953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bd634-14c5-48b1-ab6f-f141074452db None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:11.301814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 276/542] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:11.307335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:11.307623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:11.307900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:11.335200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:11.337320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:11.393172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e11e6-f9e3-4976-bfd7-5d67630bae7f None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:11.393505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e11e6-f9e3-4976-bfd7-5d67630bae7f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:11.393710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e11e6-f9e3-4976-bfd7-5d67630bae7f None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:11.395062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 277/543] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:11.404431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:11.404717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:11.404983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:11.433760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:11.434975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:11.446839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 267/544] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:11.500337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:11.524765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 278/545] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 16:53:11.799961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:11.803162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:11.903265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d92f1-6b7f-48e4-97af-2d49c273c00e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:11.946348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:11.947179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:11.947460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:11.947729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:11.961069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:11.966101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:11.967022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:11.967829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:11.971138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 268/546] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:11.977899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:11.984788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.057948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.090693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5188cd-befe-40ae-890c-f1ff55354238 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.125524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.126154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.126431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.126738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.137908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:12.142762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:12.143652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:12.145539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 269/547] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:12.150699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.193437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f6405-bd31-4ec9-a8a9-5640a401ad9e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.256368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f1f80-0480-4449-be40-a98c41712c8b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.275353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.276417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.276937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.277510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.278399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:12.279198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.280785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.293066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.293675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.293952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.294220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.294901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:12.295203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.297037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.298976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.299333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 279/548] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:12.305762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.309535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 270/549] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:12.314976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.412471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.420227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f040ef-617f-4710-b731-82cc53e15ea5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.455660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.456297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.456576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.456850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.468115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.469623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:12.484798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:12.485938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:12.487861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:12.487861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:12.487861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:12.487861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 271/550] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:12.491551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.521339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ef92-c1e6-4076-8466-4e046a728c98 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.539118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.596416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.596965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.597243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.597516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.601821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ee237-07e7-429d-915d-970aff05002a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.621152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.622616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.637644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.638257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.638537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.638835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.639475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:12.639780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.641138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:12.646261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:12.647420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:12.649731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:12.649731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:12.649731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:12.649731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 280/551] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:12.655172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.655335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 272/552] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:12.660748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.768012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e756a-1481-4246-b909-3caa8fb834f9 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.771107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.812488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.813148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.813444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.813674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.822330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.823834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-53059e5d-6a47-47db-8bf9-b311c313c776 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:12.837693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:12.838865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:12.840021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 273/553] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:12.841495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:12.841656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79410e-e82c-4ea3-b480-064bbe20d50d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.841656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79410e-e82c-4ea3-b480-064bbe20d50d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.841969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79410e-e82c-4ea3-b480-064bbe20d50d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.847247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 274/554] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:12.848091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe4ad-7a59-4106-97ab-4624d3e449ad None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:12.848480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79410e-e82c-4ea3-b480-064bbe20d50d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:12.894528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:12.895165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.895444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.895715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.896355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:12.896655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:12.898074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04134b41-bc14-4d7f-9ff3-ec868f670471 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:12.916049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 281/555] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:12.917722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:12.918380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:12.918675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:12.943723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:12.946170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:12.977550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79410e-e82c-4ea3-b480-064bbe20d50d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.018250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.018967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.019253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.019632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.020365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:13.020669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.022113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.031009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 282/556] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:13.032435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.042244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 275/557] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:13.047740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.067147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.147741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.157812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cb2c-54c3-4e34-812d-404a06047494 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.161707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6c75-e8ba-4dd2-9661-ea7cccfa8bbd None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.195578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.196553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.196977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.197390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.197502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.198069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.198335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.198607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.206027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.207583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6305ed7b-2b52-480e-8dc1-0aeaecb8a8a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:13.220003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:13.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:13.221988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:13.225729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 283/558] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:13.227239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edab99-77cf-47ec-9878-936f79517460 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.227430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edab99-77cf-47ec-9878-936f79517460 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.227687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edab99-77cf-47ec-9878-936f79517460 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.229199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 284/559] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:13.230137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edab99-77cf-47ec-9878-936f79517460 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.276920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.278763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.297655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.339296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edab99-77cf-47ec-9878-936f79517460 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.372900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.373524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.373803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.374091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.374848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:13.375161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.376664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62564c-2bd4-4f0c-9138-35dbb48e5324 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.396317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 285/560] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:13.401576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.401576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.401576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.402261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 276/561] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:53:13.403461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.411194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.418005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:13.419230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:13.494167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 286/562] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:13.494167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.517809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc99202-68bb-4c15-a0e3-f4f88e289068 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.535000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.554640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.555046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.555324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.555596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.565868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:13.571197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:13.572120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:13.572995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 277/563] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:13.574357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.610731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b5734-7373-450d-99a2-36682dd04c81 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.653717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.655311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.655594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.655862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.658929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.668991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.670443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.685014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d495a5-4c3a-488e-b21f-44798708aa03 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-4df6fa08-2a8c-43e7-b87e-e3544f6bfc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:13.685157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:13.686091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:13.687601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:13.687601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:13.687601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:13.690807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 287/564] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:13.692050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772dae-37a4-41d0-81db-703db333b5a4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.692338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772dae-37a4-41d0-81db-703db333b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.692612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772dae-37a4-41d0-81db-703db333b5a4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.693991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 288/565] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:13.694538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a772dae-37a4-41d0-81db-703db333b5a4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.726158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.726851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.727417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.727696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.737513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.739036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:13.754394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:13.755621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:13.756558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:13.756558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:13.756558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:13.761599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 278/566] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:13.762771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.791473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.803161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a772dae-37a4-41d0-81db-703db333b5a4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.838206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.838843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.839119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.839385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.840038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:13.840670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.841713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c0dc5-780b-4954-a1fa-9931f8e9a6f7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.850427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 289/567] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:13.851841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.852126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.852393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.866796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c329f-c883-469c-a5b4-b2838fb6be0f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:13.869772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:13.870961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:13.902414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:13.903066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:13.903344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:13.903619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:13.904564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:13.904844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:13.906204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:13.917493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:13.918375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 279/568] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:13.919200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:13.939170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 290/569] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:13.940003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.023838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.036382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2dd2a-691b-4551-8b8d-2ddcb85c19ea None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.066000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ffab0-9bf7-4c47-83b3-994beb026e0f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.072810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.073830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.074114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.074385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.075063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:14.075731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.077438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.094812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 280/570] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:14.095698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.104828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.105464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.105749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.106026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.116694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:14.121999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.128498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 291/571] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.129360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.173730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.213382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285eb6b-6489-433f-a5c5-2338c7438712 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.236388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c746-de78-491c-b3c1-d0a3efa10624 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.247357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.247986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.248266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.248543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.259635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.261070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.268846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.270920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.271541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.271817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.272088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:14.275998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.277143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:14.278625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:14.278625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:14.278625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:14.278625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 281/572] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.278625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.279944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.281374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:14.293990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.295055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 292/573] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.295974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.385395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1f3f-0e32-44ad-bde9-ddf736c68af3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.390813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.393951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b7f6-3d06-4250-a5c1-9a023a18700c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.419753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.420383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.420660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.420939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.427472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.428295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.428847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.428954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.429159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.429429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.430518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:14.430860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.432202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.439957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 293/574] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:14.440167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.441035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:14.441960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:14.442402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.442473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 282/575] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.442473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.501529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.544404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec987ab3-4fe4-4d8e-baf4-f9b3ae904a1c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.544719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e901f-ab68-4c29-a60a-c26df3c3f950 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.577945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.578135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.578570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.578714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.578879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.579005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.579143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.579250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.579782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:14.580089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.581457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.589126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:14.593359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 283/576] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:14.594156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:14.594333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.595392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 294/577] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.596779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.622217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.696446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f986de3-6718-4270-aa74-dd829ca2a5e0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.697772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973310b4-f378-4a8e-b667-f3628459ea09 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.716592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.730816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.730985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.731417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.731518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.731695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.731787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.731967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.732059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.732646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:14.732949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.734367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.742967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.744396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.746767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 284/578] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:14.747681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:14.760885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.761876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:14.763296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:14.763296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:14.763296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:14.763296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 295/579] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.763296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.836361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:14.850144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcfac-59e8-4c24-9022-d289d8769e6e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.861865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae293a-4cf2-4db6-b3b6-19092a778bcb None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:14.884292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.884901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.885185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.885451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.886139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:14.886452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.887897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.895678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:14.896297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:14.896582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:14.896856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] PATH_INFO: `/v3/users/glance` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:14.900408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 285/580] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:14.901202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.910186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:14.911675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:14.923527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:14.924655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 296/581] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:14.926007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:14.945932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.006708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b5f65-1287-4a99-88ae-eb591be2c39e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.024626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4cae1-10c5-44a2-bd62-73047e4dedbe None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.041235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.041844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.042125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.042399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.043087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.043392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.044771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.052475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 286/582] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.053258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.061907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.062705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.062989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.063262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.065701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.079413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=8bddbf2c5a23405bb4ae9c56e9b17d08, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.080868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.094922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 297/583] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:14 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:15.096073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.161575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cfbb3-96da-4808-9cf0-d3eee3236858 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.165371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.208854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.209484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.209772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.210036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.210836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.211332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.212831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.231818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 287/584] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.231818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.240793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223841b-c8ea-4109-bcc4-efedbe24424f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.282332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.283087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.283373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.283644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.284375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=12e995aeb6d440808a86ca23585ffdf0) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.284714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.286142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.293034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 298/585] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/role_assignments?user.id=12e995aeb6d440808a86ca23585ffdf0&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.293658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.354606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4c71-369f-4135-bb5f-5d0157ea5bea None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.355577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.399029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.400192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.400476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.400749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.401503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.401807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.403849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.417505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e36ec-306d-4003-ad5b-2807e02c9b7c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.426964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 288/586] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.427917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.455850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.466270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.467377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.467908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.468411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.481203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.483049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:15.501586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:15.502773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:15.503717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:15.503717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:15.503717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:15.510388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 299/587] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:15.511756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.552268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332247b-a2ae-400a-b4a4-d225cdbecd30 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.594256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.595042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.595397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.595762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.604460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.605698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:15.619025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:15.620032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:15.620982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:15.625119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 289/588] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:15.626246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.633910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.639133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af490bf9-46a8-44b8-bb6c-705d2959d967 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.685992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.687000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.687464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.687917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.702640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.705110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.720994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:15.724118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:15.725046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:15.726029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:15.726029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:15.726029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:15.726029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 300/589] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:15.726029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.749779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972d9fb-52e1-4bae-b142-ef434c8a8c3d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.788842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.789917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.790193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.790464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.791720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.792032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.794417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.813115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 290/590] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.813115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.862476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc6b50-329a-4e83-881c-c055a701d853 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.901119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.902096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.902923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.903383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.904894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.905651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.907496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.928858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e52de0-205c-44c6-a34e-8aa718c95352 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:15.931339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 301/591] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.932387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:15.946431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.974364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:15.978304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:15.978304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:15.978304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:15.978304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:15.978304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:15.978788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:15.989257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:15.998686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 291/592] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:15.998686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.075060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f93e9-b728-4a4e-8146-2eab6097442e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.116110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6103b-f19c-4e5e-8b51-75721a962e43 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.118185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.119628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.119628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.119628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.127557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.129294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:16.143472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:16.144482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:16.145440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:16.150593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 302/593] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:16.151631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.158312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.159223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.159684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.160177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.173874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.175571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:16.198569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:16.199638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:16.200545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:16.200545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:16.200545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:16.203336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 292/594] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:16.204442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.240026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.267316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.278780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4c7f2-dc0d-4c55-9685-2652746260b6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.316125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.317104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.317664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.318313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.321205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7e4ee-1650-4805-9fae-c70cc1bf2ef2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.326352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.328151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:16.341061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:16.341996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:16.342996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:16.345091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 303/595] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:16.346012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.361983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.362597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.363285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.363576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.364463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:16.364887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.366323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.390968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 293/596] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:16.390968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.461915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b59f08-be4d-44cb-9f9c-37bfeb568bba None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.492883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.500147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.500940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.501369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.501813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.502596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:16.503069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.504636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.511453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113cc2b-1082-43a5-9b5f-c540f6f5d987 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.522181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 304/597] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:16.523376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.524825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.563628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.564247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.564524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.564795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.565563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:16.565869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.567339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.584903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 294/598] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:16.585766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.636353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3e473-7e6b-4216-8860-bcbbdab41dcd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.675376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.676360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.676869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.677430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.689091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.690810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:16.707920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:16.708894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:16.709823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:16.709823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:16.709823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:16.716341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1b34-ca44-4c52-a0f3-6757233a76cb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.716640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 305/599] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:16.717786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.758200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.759270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.759558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.759829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.768421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.768995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.771034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:16.786112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:16.787398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:16.788325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:16.796155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 295/600] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:16.796155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.831578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:16.843694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4eb43-30a7-445e-80e2-5b34a4a7e77a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.891028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.891693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.891972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.892242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/d137d89c725440d290a2d63c4c9c67f3/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.917738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4b7b-ede9-4098-a1ed-1a6aa6c00339 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:16.918847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=d137d89c725440d290a2d63c4c9c67f3, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.920313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.935899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 306/601] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:16 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/d137d89c725440d290a2d63c4c9c67f3/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:16.937135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:16.961987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:16.963601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:16.964096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:16.964580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:16.965663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:16.966225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:16.968105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:16.983705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 296/602] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:16.989897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:17.067981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:17.082531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c150e-1376-4768-8233-b25f102295f0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:17.144998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:17.145638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.145925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.146204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.146955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:17.147383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:17.148908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:17.162424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:17.165158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 307/603] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:17.171250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:17.178275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0819-f2e7-41e9-95d0-ed22f8f7b2dc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:17.225040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:17.225381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.225551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.225831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.233937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:17.235501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:17.249338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:17.250324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:17.251281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 297/604] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:17.260037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:17.316468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bde37b-1c60-4d8e-8f39-db76b5933671 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:17.382876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:17.383993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.384492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.384997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/72ddabdd350b45c68233ea757a6aec54/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.402968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=72ddabdd350b45c68233ea757a6aec54, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:17.405088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab584d-5d13-4dbd-8e28-f4e3fc95f5f1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:17.427596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 308/605] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:17 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/72ddabdd350b45c68233ea757a6aec54/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:53:17.494797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02aff-79eb-408b-91c0-a429b520a929 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:17.548357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:17.548998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.549332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.549620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.550339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:17.550670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:17.552235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:17.567669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993427-95f0-409e-a636-05e25aca7792 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.568630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993427-95f0-409e-a636-05e25aca7792 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.568979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993427-95f0-409e-a636-05e25aca7792 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.570752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 309/606] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:17.576894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3a25-d7fb-4889-b207-8f0ef0050df7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.577284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3a25-d7fb-4889-b207-8f0ef0050df7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.577440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d3a25-d7fb-4889-b207-8f0ef0050df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.582818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 298/607] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:17.584125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:17.589040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:17.602980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-902d3a25-d7fb-4889-b207-8f0ef0050df7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:17.604657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-902d3a25-d7fb-4889-b207-8f0ef0050df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:17.618627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:17.717126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 310/608] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:17.788556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cddedc-5e34-45a4-83ab-6c3674c8bb1f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:17.829091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:17.830186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.830696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.831189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/997ef7cf46b345d0ab4085d3419cac44/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.849459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=997ef7cf46b345d0ab4085d3419cac44, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:17.851351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:17.872390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef1a8-46e2-4137-9558-9ca2a665d8d1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.872769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef1a8-46e2-4137-9558-9ca2a665d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.872932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef1a8-46e2-4137-9558-9ca2a665d8d1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.874477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 311/609] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:17.885856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 299/610] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:17 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/997ef7cf46b345d0ab4085d3419cac44/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:53:17.886083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:17.886083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:17.886083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:17.905189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:17.906849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:18.001889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 312/611] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:18.089242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.191079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:18.238551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e06c6-4b1e-4e76-9765-3edca4eb60dc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:18.294468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:18.294468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:18.294468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:18.294468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:18.306082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:18.311222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:18.312199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:18.313105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:18.315801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 300/612] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:18.321789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.322998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.443664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:18.463178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86221ab7-2c17-4e13-a676-f6f81d9b28f3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:18.491148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:18.514689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:18.515346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:18.515627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:18.515898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:18.534568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3bd97-ceee-41c0-a251-f204a5f505cb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:18.537042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:18.542144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:18.543157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:18.544009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:18.547731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 301/613] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:18.556210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.618965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:18.620380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:18.621011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:18.621504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:18.622513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:18.623051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:18.624841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:18.641630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 313/614] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:18.648896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.692169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62890-3cd9-4bcf-bd7f-caed4f95ea52 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:18.761334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:18.762317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:18.762873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:18.763424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:18.764488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:18.765009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:18.766620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:18.785132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 302/615] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:18.795633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:18.810161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc572-04cb-4942-807d-248307091a50 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:18.844998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:18.845639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:18.845925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:18.846206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:18.850949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:18.868164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:18.869621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:18.885367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:18.897182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:18.898170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:18.899189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:18.899189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:18.899189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:18.905011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 314/616] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:18.906757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.007555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7519-d2a4-4982-a9bb-9fdb42e67055 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.067700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589fd87-80b8-4444-8f7d-3f38177ba208 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.080271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.080911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.081189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.081464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.101351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.104163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:19.131638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:19.132714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:19.133624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:19.133624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:19.133624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:19.139144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 303/617] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:19.141654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.143213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.143841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.144121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.144454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.145111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:19.145455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.146866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.177824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 315/618] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:19.181240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.270803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:19.280687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd51108-42a7-4387-9a79-53d7695a77a0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.281268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:19.318128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.318680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.318961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.319712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.320514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:19.320828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.322199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.335255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 304/619] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:19.341963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.450377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85109a66-1a74-4f76-b44a-a81754fae764 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.461316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029e10-86c6-4714-8031-14a38d780abe None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.487297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.487930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.488212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.488662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.496994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.498435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:19.511217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:19.512233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:19.513221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 305/620] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:19.518520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.538248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:19.559894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.560548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.560835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.561107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.576107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.577511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:19.600363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:19.601967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:19.602975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:19.606578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 316/621] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:19.611758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.642159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00669c-fe85-465e-9129-cd21da17d75b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.691568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.692205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.692496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.692779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.693520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:19.693828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.695826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ffd17-f78b-4eae-a09e-15e8d3a43881 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.734946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 306/622] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:19.736222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898b7a-1e42-4f3f-93f6-2be7f06c577a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.736511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898b7a-1e42-4f3f-93f6-2be7f06c577a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.736786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6898b7a-1e42-4f3f-93f6-2be7f06c577a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.738769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 307/623] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:19.746147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6898b7a-1e42-4f3f-93f6-2be7f06c577a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.765530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:19.776483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96131c-30e7-43bb-b86c-e8c346535f7f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.822346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.823352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.823876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.824381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.825351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:19.825878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.826890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:19.827828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b89d5-3dd6-41f9-8b0a-d7d0bcd50188 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.848002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 317/624] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:19.849643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.850141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.850802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.863043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6898b7a-1e42-4f3f-93f6-2be7f06c577a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:19.872310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:19.873969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:19.902131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:19.903072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:19.903359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:19.903633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:19.916285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:19.918788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:19.935472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:19.936575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:19.937487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:19.937487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:19.937487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:19.937487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 308/625] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:19.937487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:19.958608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 318/626] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:19.959819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.053900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369d67-e508-4a36-acba-bbbb7b2fbf2a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.083130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.094831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.095449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.095728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.096002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.108355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.140193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295fdd-20a9-45ee-a09d-6272ab50ca07 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.174463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.176272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.220805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.221445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.221726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.221996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.222671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:20.222978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.224382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.265009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 319/627] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:20.283679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.295835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 309/628] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:20.301562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.340799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.427021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c364e-2313-4248-b2b2-f583faafe7e1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.431424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca017459-4607-4591-9e52-3e2536e90aea None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.469474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.470255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.470574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.470945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.471766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.472408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.472688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.472978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.483718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.485579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.491737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.493603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:20.502323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:20.503611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:20.504749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:20.508279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 320/629] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:20.509815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.515109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-167f25b8-a8fa-4bb2-a642-dec6d95bead8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:20.520413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:20.521408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:20.522320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:20.522320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:20.522320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:20.526408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 310/630] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:20.527830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1696d-17fd-4dd9-9061-bea9247e83b1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.528030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1696d-17fd-4dd9-9061-bea9247e83b1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.528300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1696d-17fd-4dd9-9061-bea9247e83b1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.530145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 311/631] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:20.530811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1696d-17fd-4dd9-9061-bea9247e83b1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.627769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e297897-1204-407f-8eae-bc3da6f9023d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.628198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.654723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1696d-17fd-4dd9-9061-bea9247e83b1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.663221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.663854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.664297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.664669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.674934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:20.680790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:20.681745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:20.682951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 321/632] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:20.683820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.694165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.694822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.695106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.695937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.697001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:20.697318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.699364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc1dd-0ad0-44b4-9108-f29354b48d26 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.713206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 312/633] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:20.714793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63857cd-18d5-419f-ab82-3f048e589fed None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.715079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63857cd-18d5-419f-ab82-3f048e589fed None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.715352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63857cd-18d5-419f-ab82-3f048e589fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.733808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a63857cd-18d5-419f-ab82-3f048e589fed None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:20.735027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a63857cd-18d5-419f-ab82-3f048e589fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:20.750906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.793007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2e81-7cc3-4ab1-9bc7-0ae8fa4e2a90 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.811765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 313/634] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:20.813028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00371-8dae-46fc-b304-b8b7660d3d2a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.813322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00371-8dae-46fc-b304-b8b7660d3d2a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.813600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b00371-8dae-46fc-b304-b8b7660d3d2a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.815131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 314/635] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:20.815837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b00371-8dae-46fc-b304-b8b7660d3d2a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.828288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.828894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.829172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.829439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.830077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:20.830380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.831779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.849348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 322/636] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:20.849348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:20.895035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.936127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b00371-8dae-46fc-b304-b8b7660d3d2a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.950274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3765e-e85d-4095-a355-5a2ed0b36fcb None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:20.974042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:20.974779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.975547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.975547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.975992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.977593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:20.977931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:20.979334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942368b-a74a-4c69-813c-3a058eb9d00a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:20.988699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 315/637] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:20.989982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.990269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.990541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:20.997769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:20.999188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:20.999475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:20.999745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/12e995aeb6d440808a86ca23585ffdf0/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.010462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:21.011718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:21.016024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=12e995aeb6d440808a86ca23585ffdf0, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.017487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.031629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 323/638] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:20 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/12e995aeb6d440808a86ca23585ffdf0/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:21.043651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.090018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 316/639] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:21.091108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.179236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c78770-0d25-49cf-a305-b3c77e735242 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.183756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.222789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.223523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.223875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.224238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.234376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.235877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.244167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be658-1996-4340-a226-33ac474b0ac0 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:21.248078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:21.248977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 324/640] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:21.249952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.287505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.288433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.288716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.289625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.292278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.305254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.306972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:21.324645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:21.325658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:21.326588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:21.326588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:21.326588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:21.326588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 317/641] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:21.327308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.378748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4235bd-740a-42da-a5c2-2a1ad3ae10fa None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.415895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.416533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.416815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.417087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.427844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:21.433417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:21.434600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 325/642] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:21.435582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.450684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ac37-c3a3-4cd0-99ed-caeffbd491a4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.462634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.489302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.489907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.490184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.490752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.491176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:21.491481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.493155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.506237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 318/643] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:21.507242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.542842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.550005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b764f7-7e3b-49c0-afc6-f83faa95711f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.589310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.589918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.590199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.590468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.591139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:21.591441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.592809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.606395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 326/644] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:21.607245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.624598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0ce80-a943-4293-86ce-a2b1c3d066c6 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.666411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.667361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.667849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.668189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.680017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:21.685152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:21.686275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 319/645] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:21.687483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.716285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2460ca-b608-452b-804e-8f9d4bd5ba86 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.719230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.751872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.752854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.753232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.753587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.754525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:21.754639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.756118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.765392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 327/646] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:21.766193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.786712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:21.806647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1acd8-a002-437b-ae94-a080406bee4d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.846806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.847413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.847691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.847966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.848687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:21.848992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.850417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.856953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 320/647] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:21.858358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:21.887236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82e9bf-d7c1-4690-96f3-5033909099b1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:21.941823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:21.943015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:21.943363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:21.943703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:21.956807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:21.958595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:21.977999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:21.979795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 328/648] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:21.980773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.001059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.010592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67a823-d390-4ca5-90e0-e1f4cb14d20c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.063254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.064142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.064423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.064697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.065620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:22.065927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.067929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.082915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 321/649] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:22.083718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.089837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.121114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df700b-e5eb-4cb9-ba9c-e661f7e99297 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.163394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.164655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.165109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.165524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.177441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.179259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:22.196128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:22.197688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:22.198845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:22.198845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:22.198845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:22.205002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 329/650] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:22.206018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.213256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c51ef-cc25-4b5c-b6c3-1885b2fe5aee None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.250792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.251554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.251940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.252509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.253233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:22.253646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.255366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.275804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 322/651] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:22.276806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.298179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.318547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e7a4-c0f9-4a0b-8483-cc6845bfb9c5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.347953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.359317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.360169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.360590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.361004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.373244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.374922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:22.392004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:22.393084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:22.393984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:22.393984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:22.393984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:22.396107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 330/652] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:22.396458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061590-eb47-4d1b-810f-493588253aca None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.397368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.435662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.436429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.436816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.437194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.437941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:22.438441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.440095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.458493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 323/653] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:22.458493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.514603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd3de-a17e-4308-bbed-1827ee202338 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.540234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.553837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.554906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.555402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.555874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.568849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-7fa9-4930-8b80-037ed3485896 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.606370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.607029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.607317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.607593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.608234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:22.608537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.609318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.618683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.633544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.634127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 324/654] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:22.635136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.636022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.745930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d94d3-3d35-45b8-9296-048a5fe98e32 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.746117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 331/655] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:22.747218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.788413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.789716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.790469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.790469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.792586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.798998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.800927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:22.814273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:22.815369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 16:53:22.816331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:22.821573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 325/656] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:22.822491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.841264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:22.864147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70fc4c-15ee-4363-9fb4-123bae4a0617 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.903394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.905058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.905515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.905957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.914685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.916418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:22.929399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:22.930834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:53:22.931800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:22.934479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 332/657] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:22.935681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:22.938936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c016-e3e9-4748-88ef-327847c5eec9 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:22.978964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:22.978964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:22.978964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:22.978964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:22.995704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:22.997649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:23.012855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:23.013988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:23.015038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:23.015038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:23.015038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:23.019527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 326/658] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:23.020580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.052747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8eb6-fda9-43aa-ac33-a4368730f466 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.071755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.092399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.093320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.093830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.094298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.095267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:23.095770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.097397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.108388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.123043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 333/659] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 22 16:53:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:23.123043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.137528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba889e-8fbf-460d-8a9e-808016644f1a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.177434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.178472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.178940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.179458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.180633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:23.181205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.183128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.205080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 327/660] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:23.206336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.227924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c23b90-9dad-4540-aff2-fb3d65b63ef4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.274623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.275636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.275955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.276272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.276926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:23.277479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.279871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.298690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 334/661] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:23.298690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.319116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b307a-dee6-4238-a0a0-fb29d23fb09e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.322933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.358470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.358695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.359686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.359886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.360441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.403726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c436b65-4618-4e7a-a6ed-1fa511759cb3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.435764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.437221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b03a17-de55-4c61-a457-075189c64653 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.445000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.445867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.446237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.446506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.516157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.517736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 328/662] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb923-32f7-4398-8c4a-cb5a7f713356 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb923-32f7-4398-8c4a-cb5a7f713356 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb923-32f7-4398-8c4a-cb5a7f713356 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 329/663] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:23.548510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb923-32f7-4398-8c4a-cb5a7f713356 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.553480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.583579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.634376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 335/664] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:23.635480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.661107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb923-32f7-4398-8c4a-cb5a7f713356 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.696982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.697850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.698232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.698589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.705613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.707069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c7f75337-e71a-425c-9f25-b1d4497de370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:23.720542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:23.721478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 330/665] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.727773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.728548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.745161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3cad5-e690-46ed-9a5d-9ebc44e05792 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.745517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:23.747526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:23.783408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.784051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.784337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.784616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:23.795866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:23.797322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:23.813315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:23.814487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:23.815669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:23.815669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:23.815669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:23.817044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 336/666] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:23.817952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.825883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.831853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:23.846680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 331/667] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:23.846680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:23.950148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c388d56-a496-465b-947c-fb71c6ea0d83 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.958807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749e10-fb86-4e4d-88df-826384e7d17f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:23.995601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:23.996508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:23.996788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:23.997060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.003330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.004034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.004382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.004728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.005512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.005913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.007466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.010499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.012428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.021645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 332/668] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.023202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:24.031267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:24.032304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:24.033204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:24.033204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:24.033204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:24.033204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 337/669] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:24.033953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.097071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.104397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.150900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b9db-0c15-414a-a480-1df4e5b7dcb4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.159030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bc4bc-c434-4f58-b166-c503311c8c2d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.185572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.186180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.186470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.186775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.187507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=d137d89c725440d290a2d63c4c9c67f3) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.187817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.189268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.196272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 338/670] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/role_assignments?user.id=d137d89c725440d290a2d63c4c9c67f3&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.196896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.197339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.197954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.198234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.198504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.199183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.199489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.200877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.220274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 333/671] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.220274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.324477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64017dfa-ac4d-42d6-b68d-c85f45ec4ad1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.332921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eafb55-467c-4e7d-83b6-368ef5526305 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.350328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.352533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.362928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.363551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.363855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.364103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.364914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.365069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.366453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.377000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.377637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.378344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.378344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.381682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 339/672] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.382365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.394961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-5dbc10df-a92b-45c1-b90b-3f74c8baa774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:24.400291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:24.401247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:24.402175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 334/673] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:24.403054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177ae3-0399-4965-8b47-939ec648ac32 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.403054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177ae3-0399-4965-8b47-939ec648ac32 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.403466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177ae3-0399-4965-8b47-939ec648ac32 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.406861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 335/674] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:24.407444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177ae3-0399-4965-8b47-939ec648ac32 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.510851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9627b-161e-4023-8fee-635ecb75d732 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.528724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177ae3-0399-4965-8b47-939ec648ac32 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.548324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.549297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.549755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.550731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.560867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.562842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.565165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.566100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.566388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.566688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.573996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.575469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:24.577498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:24.578532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:24.579689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:24.581713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 340/675] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:24.582714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-ee611431-a977-47c0-af17-5527ceced3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:24.589886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:24.590852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:24.591787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 336/676] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:24.597454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.597454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.597454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.612716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:24.614089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:24.635672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.651566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.694465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17010-1ada-404b-87f6-84d6928ad61a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.702691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 337/677] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:24.702691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.758500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.760172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.760672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.761169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.762020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.762576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.764322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.774808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 341/678] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.776253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.822697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3ad1-7b73-47fe-ba54-8ceb19d13a2a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.868514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.869747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.871212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.871677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.872552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.873055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.874925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.891327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 338/679] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.892558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:24.901634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d061-dc7e-4709-b724-c372a8172a47 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:24.911360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.930417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:24.939973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:24.940596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:24.940877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:24.941151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:24.941846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:24.942151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:24.943768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:24.958443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 342/680] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:24.959324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.028751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250230e-fb1f-4b67-938f-66befb7659d7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.063419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.064052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.064334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.064608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.071416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67d260-1396-496d-9d1c-d692d0a9c9ee None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.075936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.077392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:25.093090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:25.094089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:25.095015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:25.095015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:25.095015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:25.095015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 339/681] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:25.095015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.112833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.113451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.113730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.114003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.114754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=72ddabdd350b45c68233ea757a6aec54) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:25.115072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.116758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.130759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 343/682] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:24 2022] GET /identity/v3/role_assignments?user.id=72ddabdd350b45c68233ea757a6aec54&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:25.130759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.165718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.213264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.247594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904f0dd-9bf1-4f81-9c58-2bdfa7def1d7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.264784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332f4c0-43e5-456f-bd89-61119e7fd74a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.297115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.297732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.298011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.298289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.299082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=997ef7cf46b345d0ab4085d3419cac44) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:25.299379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.300823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.308493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 340/683] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/role_assignments?user.id=997ef7cf46b345d0ab4085d3419cac44&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:25.309508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.312395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.313094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.313377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.313653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.327113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:25.332625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:25.333569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:25.334425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 344/684] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:25.340348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.423287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb369ac-9fe3-4ac9-99ad-d63136fe47dc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.449229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.460004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828a46-421b-4286-8ab3-97d6d0ef863f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.463073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.463702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.463984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.464259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.464910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:25.465214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.466597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.478131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.481453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 341/685] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:25.487942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.498840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.499472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.499757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.500034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.500710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:25.501016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.502417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.512750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 345/686] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:25.519378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.611263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483b70-178f-4eea-98ad-99b84c1afb9d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.651615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.652257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.652539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.652818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.655735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2522b-64ef-4d68-b66a-1a09f5bf30e9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.661145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.662699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:25.676884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:25.678072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:25.679314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 342/687] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:25.684559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.701850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.702747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.703176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.703597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.718394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.720641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:25.740821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:25.742190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:25.743611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:25.743611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:25.743611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:25.745996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 346/688] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:25.755730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.770446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.770624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:25.819031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3fc53-cccb-4e1f-ae95-2638427166c5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:25.855145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:25.856063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:25.858687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:25.858687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:25.858687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:25.858687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:25.859220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:25.886723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 343/689] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:25.891839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:25.933707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1562-f207-4eb1-b4a2-34085cb5997f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.000404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.001097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.001301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.001581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.002226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:26.002534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.003960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.034181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 347/690] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:26.040155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.088073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113e454-8444-4f7f-af61-6a4c047d6fd3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.124000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.153147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.157209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.157945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.158225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.158587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.227049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069a932-0073-4002-b076-a609338a7fe0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.243528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.245005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.281064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.281711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.281996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.282275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.290459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.292081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:26.304112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:26.305707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:26.306718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:26.310112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 348/691] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:26.311327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.371299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 344/692] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 16:53:26.376997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.399080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.432143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c020a9-e0a9-413a-abfa-8aad25d6d8ff None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.481643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.501843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.502459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.502767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.503043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.503785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:26.504092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.505532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.547093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 349/693] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:26.550159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.560577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb55a3-5196-45ac-bdb6-a01313c4280f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.630690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.631335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.631617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.631894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.652577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.654069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-77d513d6-8080-4c24-a789-7e24598870d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:26.681409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:26.682453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:26.683396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:26.683396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:26.683396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:26.683396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 345/694] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:26.686690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b4cf-bf7b-40eb-8163-c13606bd73ef None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.686690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b4cf-bf7b-40eb-8163-c13606bd73ef None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.686690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b4cf-bf7b-40eb-8163-c13606bd73ef None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.687534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 346/695] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:26.691045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b4cf-bf7b-40eb-8163-c13606bd73ef None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.723449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991903-0835-4d9b-9095-1cdd80850ab4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.768067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.768606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.768891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.769167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.778977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.812717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b4cf-bf7b-40eb-8163-c13606bd73ef None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:26.826696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:26.845324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.846950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.856225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:26.856882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.857685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.857969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.858610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:26.859359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:26.861090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2c32f-a21a-4ec8-870a-c3975c43f4f8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:26.877633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 347/696] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:26.879355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:26.879637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:26.880320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:26.905923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:26.907409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:26.974751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 350/697] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 16:53:26.975687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:26.989222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 348/698] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:26.996374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.059525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.108746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f30d-938b-41a5-a31d-f8668e56a4b3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.135057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.149261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.149894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.150170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.150441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.163233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.165563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.166260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073c1d-84e1-400e-a662-f89cf658678a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:27.181371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:27.185555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:27.187683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:27.187683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:27.187683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:27.187683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 349/699] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:27.189375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.239445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.240082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.240361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.240630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.258773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.266041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:27.281960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:27.284204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:27.286311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:27.291500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 351/700] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:27.296999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.363152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd56f6-28c3-44aa-8343-97fb9d942512 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.381075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.408540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.409152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.409420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.409690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.410329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:27.410631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.414500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.434749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 350/701] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:27.435691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.459862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0d854-fd5a-4cc2-89a6-2afc76667992 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.502048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.502981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.503659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.503931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.504961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:27.505268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.507826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.524594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 352/702] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:27.525824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.531117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.549075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a4a7-a9e4-4b24-a48a-936dde27d3b5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.586429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.587378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.587610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.590686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.599316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.601045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:27.618709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:27.620671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:27.622807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:27.622807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:27.622807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:27.626718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 351/703] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:27.626718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.655843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.668192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffd9f-41c1-46ea-9e7a-a5df155643b3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.721326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.722223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.722941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.723843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.732714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.734169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.745693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaa923-a1a5-45e2-a03b-ffc9f59970f8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:27.746203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:27.747327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 353/704] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:27.748357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.796655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.798030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.798567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.799019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.800272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=12e995aeb6d440808a86ca23585ffdf0) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:27.801228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.803414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.812308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 352/705] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/role_assignments?user.id=12e995aeb6d440808a86ca23585ffdf0&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:27.813979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.817086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.863326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb928d-0c3f-4d10-9e2e-ad88febed197 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:27.903095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:27.903633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.904240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.904240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.905207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:27.905522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:27.906977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f60c8-d7ac-4ab0-8ede-963b99ad6007 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:27.924976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 354/706] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:27.926491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591578d2-c6a1-4000-b2ae-3401de81a3ae None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:27.926814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591578d2-c6a1-4000-b2ae-3401de81a3ae None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:27.927094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591578d2-c6a1-4000-b2ae-3401de81a3ae None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:27.928694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 355/707] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:27.929408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591578d2-c6a1-4000-b2ae-3401de81a3ae None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:27.948578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:27.966546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad98048-63da-474c-91fd-ca8d7578d7bb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.011596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.012229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.012533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.012791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.013510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:28.013824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.016002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb452a-7eca-49ee-b22d-cce30304c9cf None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.032828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 353/708] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:28.034784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064c87c-0dcb-47b4-89a5-ebe1a5acd494 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.035081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064c87c-0dcb-47b4-89a5-ebe1a5acd494 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.035361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064c87c-0dcb-47b4-89a5-ebe1a5acd494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.055331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5064c87c-0dcb-47b4-89a5-ebe1a5acd494 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:28.056534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5064c87c-0dcb-47b4-89a5-ebe1a5acd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:28.063490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591578d2-c6a1-4000-b2ae-3401de81a3ae None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.089807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:28.104154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.104780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.105060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.105339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.105988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.113430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.137752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 356/709] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:53:27 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:28.138480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:28.145068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 354/710] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:28.147004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016baddb-083c-424e-9f90-740bcc79cb0c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.147457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016baddb-083c-424e-9f90-740bcc79cb0c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.147880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016baddb-083c-424e-9f90-740bcc79cb0c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.150194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 355/711] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:28.162294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.162878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.163323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.189481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:28.191477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:28.279486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944204b-dc0f-48ff-95fd-af64c185300f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.331913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 356/712] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:28.346781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.347396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.347684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.348011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.348745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:28.349053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.350531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.357616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 357/713] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:28.443228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:28.454931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:28.565086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406244-b751-4dc9-99fb-b41796623879 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.606455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.607879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.608180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.608460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] PATH_INFO: `/v3/services/network` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.609053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.610424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:28.621921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:28.623049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:28.623998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.626783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 357/714] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:28.633686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:28.635711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:28.699234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:28.716833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:28.769604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157143-e5bd-456f-b9e2-b5fec7cd6972 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.829366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d41f1-dea9-4141-984c-a7ed1f5addfe None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:28.832335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.832979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.833257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.833530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.834116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.835521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:28.853563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:28.854623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:28.855553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:28.860626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 358/715] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:28.865276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:28.905742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:28.906363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:28.906640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:28.906942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:28.907570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] RBAC: Adding query filter params (name=network) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:28.907872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:28.909237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:28.920323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 358/716] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:28.924933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:29.066602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38285f91-7f01-41ba-acdf-65e3a3c705f8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:29.112952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:29.113568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:29.113854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:29.114122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:29.114782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:29.115091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:29.116452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:29.123954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:29.127494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 359/717] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:29.129239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0e1b2-35cb-4834-8749-c891e35e0d92 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:29.137517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:29.147971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:29.194950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:29.195605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:29.195886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:29.196158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:29.196796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] RBAC: Adding query filter params (type=network) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:29.197098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:29.200042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfcbba-c979-4eb1-b684-3d432da902ad None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:29.214059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 359/718] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:29.313400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380689b-49b6-4d9b-8343-befafb1a2241 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:29.360537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:29.361226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:29.361517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:29.361791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:29.362432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:29.362759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:29.364152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3aba66-da9f-41c8-a5d0-7fedc4f7621e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:29.370903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 360/719] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:30.720491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4eb7f-0bec-4ceb-9818-9e99bfacef24 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:30.721064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4eb7f-0bec-4ceb-9818-9e99bfacef24 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:30.721064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4eb7f-0bec-4ceb-9818-9e99bfacef24 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:30.722742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 360/720] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:30.729374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bce0f-1f4d-451b-942e-12bff0d2091d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:30.729913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bce0f-1f4d-451b-942e-12bff0d2091d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:30.729913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bce0f-1f4d-451b-942e-12bff0d2091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:30.755223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d98bce0f-1f4d-451b-942e-12bff0d2091d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:30.756425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d98bce0f-1f4d-451b-942e-12bff0d2091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:30.836747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:30.845619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 361/721] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:30.919944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0b98b-ca86-4d3c-a2d8-4e2e9ff8d76e None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:30.920257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0b98b-ca86-4d3c-a2d8-4e2e9ff8d76e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:30.920520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0b98b-ca86-4d3c-a2d8-4e2e9ff8d76e None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:30.922108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 361/722] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:30.927048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188b78-2ab6-478a-b736-f15060ca9b5f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:30.927335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188b78-2ab6-478a-b736-f15060ca9b5f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:30.927611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188b78-2ab6-478a-b736-f15060ca9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:30.955619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-60188b78-2ab6-478a-b736-f15060ca9b5f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:30.956867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-60188b78-2ab6-478a-b736-f15060ca9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:31.053790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 362/723] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:31.108941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e02c3-30a1-4d0f-b0ba-2f1e1592af18 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.109562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e02c3-30a1-4d0f-b0ba-2f1e1592af18 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.110074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e02c3-30a1-4d0f-b0ba-2f1e1592af18 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.111893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 362/724] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:31.116717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.117198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.117663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.138868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:31.140034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:31.219285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 363/725] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:31.257643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e02c3-30a1-4d0f-b0ba-2f1e1592af18 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.379854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e02c3-30a1-4d0f-b0ba-2f1e1592af18 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.406896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.422353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.423069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.423350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.423685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.445587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:31.450389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:31.451407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:31.452265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:31.459636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 363/726] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:31.466335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.467927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:31.515743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734185b-155d-4785-a7ad-22e9d919da94 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.521983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:31.555293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.556195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.556813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.557329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.575163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:31.580929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:31.582074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:31.583094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:31.588487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 364/727] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:31.601039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.671007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490ec31-a773-4833-8ccd-a468c57c4a6f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.714632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.714632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.714955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.715162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.715903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:31.716209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:31.717668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:31.732200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 364/728] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:31.733112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.747741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b01b9-3c97-4ab9-ad68-74c8b7c0684b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.766291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:31.794627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.795577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.796022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.796442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.797769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:31.798274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:31.800306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:31.813729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 365/729] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:31.815383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.854837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:31.863903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f909927-e17a-4055-9461-bb650e2742ff None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.901896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.902845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.903306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.903784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.916262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:31.921541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:31.922498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:31.923389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:31.925884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 365/730] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:31.927066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:31.932965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157848a-7177-4b28-8629-1ee14028c1e9 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:31.973407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:31.974080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:31.974365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:31.974723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:31.987741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:31.990110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-357041c9-ae77-4640-b052-b20c124f0bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:32.008785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:32.014435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 366/731] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247939d-0c2d-4481-a7b1-2bfab80fe24a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247939d-0c2d-4481-a7b1-2bfab80fe24a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247939d-0c2d-4481-a7b1-2bfab80fe24a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 367/732] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:32.015425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247939d-0c2d-4481-a7b1-2bfab80fe24a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.048336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291fae4-8410-48ec-a818-317eb67f6ead None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.049168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.083636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.084270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.084551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.084822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.096216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.097707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:32.112376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:32.113557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:32.114467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:32.114467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.114467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:32.114467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 366/733] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:32.114757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.124345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.136386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247939d-0c2d-4481-a7b1-2bfab80fe24a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.170566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.171210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.171491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.171774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.172459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:32.172766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.174128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ed19-9171-480e-a6db-4fda781bb2a7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.183076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 368/734] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:32.184306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.184593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.184869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.202872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:32.204066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:32.216176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781331-99fd-4601-8e70-c61e6b2f43b4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.249889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.250585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.250799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.251073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.251712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:32.252017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.253383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8e88f-f03b-447c-86a0-1c7249179137 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.265272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 367/735] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:32.266424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef4d8-0b51-4b25-afe0-b5ba6dc52ec4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.266733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef4d8-0b51-4b25-afe0-b5ba6dc52ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.267001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ef4d8-0b51-4b25-afe0-b5ba6dc52ec4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.268343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 368/736] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:32.268872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ef4d8-0b51-4b25-afe0-b5ba6dc52ec4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.274042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 369/737] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:32.274933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.297273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.362852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.379834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7f838-646e-4d33-9c18-ba27d315776c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.402340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ef4d8-0b51-4b25-afe0-b5ba6dc52ec4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.415295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.415933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.416216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.416488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.426833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.428281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.439021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60696-290a-4624-b792-25099784821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.439697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60696-290a-4624-b792-25099784821f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.440046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60696-290a-4624-b792-25099784821f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.440385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60696-290a-4624-b792-25099784821f None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.441140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60696-290a-4624-b792-25099784821f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:32.441512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60696-290a-4624-b792-25099784821f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:32.442837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:32.443984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:32.444902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:32.444902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:32.444902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:32.445084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60696-290a-4624-b792-25099784821f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.445158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 370/738] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:32.445158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.461186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 369/739] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:32.462536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.462856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.463132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.483354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:32.484536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:32.524029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.555594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 370/740] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 16:53:32.556442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.558858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8163b83-a1f9-47a8-b5f9-d83083622a9b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.595136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.595757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.596038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.596312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.604883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.606309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:32.617695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:32.623614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 371/741] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:32.624602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.629300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.675829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e490743-64d7-49d2-b73e-ecf7620812ff None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.711623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.712536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.712825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.713098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.713804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:32.714116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.715512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.740491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 371/742] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:32.740491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.741174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074e7a-8235-4add-8a5f-9699049d5961 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.770849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.776995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.777631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.777911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.778183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.786040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.787494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:32.798718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:32.799905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:32.801102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:32.805149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 372/743] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:32.805829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.848330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b809-32e6-4acb-8334-99089212970e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.864200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:32.883768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.884284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.884566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.884841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.885488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.886869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:32.901987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 372/744] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:53:32 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:32.903040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:32.910645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb39494-e300-4295-bde8-d5353d5c7969 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:32.967462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:32.968083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:32.968364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:32.968640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:32.969386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:32.969692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:32.971204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.001425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 373/745] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:33.001425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.022182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3dc1f-dff5-4579-b112-9883ad69962a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.053452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.061192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.061843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.062128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.062413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.071181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.072787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:33.084995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:33.086345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 373/746] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:33.087341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.119217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392ee8a-31ca-48f3-9e5b-5d3aab06f613 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.135238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.157575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.158187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.158495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.158778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.159502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:33.159804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.161251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.179962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 374/747] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:53:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:33.180571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.208168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee385d92-b08d-4da7-a446-d2f3cf71dc9b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.243992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.244608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.244893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.245167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.245849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.247400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.264526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 374/748] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:53:33 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:33.265827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.295626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb6efa-7257-4a3f-8966-121f1db93bca None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.299942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.347330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.348406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.348923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.349400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.412202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.420610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29469c80-a701-421a-b6c2-692cdf024ed9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.451166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.452986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.463017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.463017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.463291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.463634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.464485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:33.464898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.466430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.486080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 375/749] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:33.486987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.586912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.591427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 375/750] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:33.592618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.622308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ab634-ec81-4437-8c17-33f838789989 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.672101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.673193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.673682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.674104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.707889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.719190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e5a0-aa86-4c17-85a8-0e15c7263424 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.760637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.761453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.761737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.762012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.765092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.767108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.773589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.775072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:33.791792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:33.792805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:33.793759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:33.793759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:33.793759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:33.797668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 376/751] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:33.798966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.860604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.894609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 376/752] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:33.895901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:33.915476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5991-006e-4ba2-b1fb-efd6a0f5fd72 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:33.968477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:33.969583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:33.970031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:33.970598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:33.972152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:33.994685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:33.996562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:34.014408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:34.015456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:34.016351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:34.016351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:34.016351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:34.018819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 377/753] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:34.019900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.036182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88735937-1e77-49fe-b193-5770da2a1c56 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.085482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.086276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.086804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.087292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.088018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:34.088400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.090600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.107936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 377/754] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:34.108927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.141265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeccdb8-94f1-41f4-acbb-bb421e1e188a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.145683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.189896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.190584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.190963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.191311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.204127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.205976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:34.224120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:34.225094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:34.226008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:34.226008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:34.226008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:34.230295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 378/755] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:34.231698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.234629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c10c8c-0753-4c94-97c6-f481791c568d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.251592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.275176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.276162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.276685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.277183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.278031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:34.278536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.280397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.293210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 378/756] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:34.294417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.356093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fda59f-f8dd-4d81-9df8-9003f82134a3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.402085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.402760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.403049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.403328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.411705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.413319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.418880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20101517-7664-43cf-b578-9c7efd10aa53 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:34.426539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:34.427580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 379/757] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:34.429046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.451828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.459574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.460636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.461661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.462133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.463018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:34.463531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.465107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.477553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 379/758] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:34.478733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.514702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.561394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f764c5-7f99-4496-beaa-7ebbe5b84ff4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.586219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdce0f-9b75-436d-ae0c-d1899e027643 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.603794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.604444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.604732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.605014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.612985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.616333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.625911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.626535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.626804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.627083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.627782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:34.628085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.629522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:34.633862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:34.634827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.635769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:34.638283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 380/759] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:34.639453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.644119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 380/760] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:34.644595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.740907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.752387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:34.761576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b959ab-c472-44d3-b77f-131af84bfbfe None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.771742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1730bb-324e-4c2e-be71-8377d616fe8a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.798286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.799071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.799499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.799869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.800648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:34.801072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.802764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.814093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.815267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.815738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.815846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 381/761] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:34.816282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.816766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.826009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.828274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:34.936928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d6f43-eef9-42cf-bc80-367fcfa74871 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:34.973765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:34.974825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:34.975770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 381/762] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:34.976262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:34.984533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:34.984711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:34.984961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:34.985238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:34.993081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=8bddbf2c5a23405bb4ae9c56e9b17d08, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:34.995689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:35.016275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 382/763] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:34 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:35.017690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:35.044102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:35.108948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa4d0-b4ec-47e9-b443-06e23335eaef None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:35.173249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:35.173873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.174149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.174419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.174797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8cec3-cd09-4b60-9a7c-e480ed2a33af None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:35.175195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=12e995aeb6d440808a86ca23585ffdf0) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:35.175502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:35.177267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94a9d-259c-4a02-b4df-ca9dc79ab73d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:35.182568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:35.185967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 382/764] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:34 2022] GET /identity/v3/role_assignments?user.id=12e995aeb6d440808a86ca23585ffdf0&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:35.192314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f69b-7541-4097-baa8-7f637f98893b None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.192952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f69b-7541-4097-baa8-7f637f98893b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.193433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556f69b-7541-4097-baa8-7f637f98893b None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.198536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 383/765] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:35.207256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86da-a8aa-44e9-b012-ab2325481478 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.208129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86da-a8aa-44e9-b012-ab2325481478 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.210581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a86da-a8aa-44e9-b012-ab2325481478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.247897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0b5a86da-a8aa-44e9-b012-ab2325481478 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:35.249798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0b5a86da-a8aa-44e9-b012-ab2325481478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:35.269197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:35.269717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.269992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.270257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.271003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:35.271584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:35.273156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:35.296770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 383/766] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:35.303590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:35.347998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 384/767] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:35.401517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:35.429788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282179b-8232-4300-95fc-4bf4043e399a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:35.466876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:35.467485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.467772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.468035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.468799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bbff8baec7248ecbffe330a168cab5a) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:35.469065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:35.470492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23931d0c-3f17-4085-96e3-bc0de059f5c0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:35.482580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 384/768] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:35 2022] GET /identity/v3/role_assignments?user.id=8bbff8baec7248ecbffe330a168cab5a&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:35.640116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eb84-63fb-490e-97d8-5f42f1119699 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.640520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eb84-63fb-490e-97d8-5f42f1119699 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.640696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eb84-63fb-490e-97d8-5f42f1119699 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.642335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 385/769] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:35.647771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.648274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.649114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.676045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:35.677255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:35.684327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701eb84-63fb-490e-97d8-5f42f1119699 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:35.766371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 385/770] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:35.863281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701eb84-63fb-490e-97d8-5f42f1119699 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:35.897238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:35.905157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:35.906100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:35.906600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:35.907088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] PATH_INFO: `/v3/services/network` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:35.907864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:35.909496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:35.919155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:35.920167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:35.921017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:35.923960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 386/771] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:35 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:35.930067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.027039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:36.061181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.082303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e149e37-f2a0-4774-ae8b-2c40b618ab37 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.163383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.163907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.163907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.165151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.165974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] RBAC: Adding query filter params (name=network) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:36.166279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.167681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.176491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 386/772] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:36.182461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.188846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e7376-3b8a-47bb-a239-6034d1fa96eb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.256749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.257399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.258189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.258475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.259158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.260620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:36.279343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:36.280928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:36.281980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:36.284013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 387/773] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:36.292150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.323448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25f2b-5b25-4fc8-9e6c-bd53ea9abaee None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.355072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:36.361812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.362835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.363319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.363789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.364611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] RBAC: Adding query filter params (type=network) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:36.365133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.366708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.373170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 387/774] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:36.379279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.416405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:36.469220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd12230-6f74-4db3-8cea-2937896e918a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.532729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.533349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.533628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.533903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.534533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:36.534863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.536225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.545575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 388/775] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:36.546795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.558609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9192e-0437-4505-8fdc-96f92a0a2226 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.598455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.599460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.599962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.600509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.601562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] RBAC: Adding query filter params (interface=public, service_id=9fdf84234de3485d94b8eeef87227f0e, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:36.602343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.604108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.612740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 388/776] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/endpoints?service_id=9fdf84234de3485d94b8eeef87227f0e&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:36.619688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.692773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:36.737487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8f588-d440-4372-a044-b5072af0c7c8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.756738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b0dd9-e957-4321-b353-20e80eeb9d00 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.775701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.777573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.778108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.778576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.779399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.781353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.787343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 389/777] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:36.802453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:36.816355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:36.817328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:36.817867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:36.818359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:36.819298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:36.819834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:36.822861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:36.829428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 389/778] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:36.835976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:36.968659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199cde2-0040-4e5e-b684-9f4d4cfca9a0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:36.995093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:37.005816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:37.006430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.006735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.007009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:37.008342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] RBAC: Adding query filter params (interface=public, service_id=12527e264afb461ab58da86e2dbac1c9, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:37.008864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:37.010442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f67ef0-b3b7-4d4b-82f6-a88ab724d3a0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:37.015914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 390/779] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:53:36 2022] GET /identity/v3/endpoints?service_id=12527e264afb461ab58da86e2dbac1c9&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:37.021596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:37.128908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec14e-2da2-4fe8-831b-f64c2886dab4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:37.169772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:37.170379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.170683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.170958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:37.171556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:37.172906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a332c24-0285-4222-9dbb-2c039dba955f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:37.184320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 390/780] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:53:37 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:37.845142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8542-b01f-4575-a8d0-9462ca96dd30 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.845640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8542-b01f-4575-a8d0-9462ca96dd30 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.846051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d8542-b01f-4575-a8d0-9462ca96dd30 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:37.847822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 391/781] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:37.853911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.854317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.854725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:37.880969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:37.882190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:37.949705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:37.964884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535d19-25e5-407e-ae6d-d7a15177d947 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.965176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535d19-25e5-407e-ae6d-d7a15177d947 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.965438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535d19-25e5-407e-ae6d-d7a15177d947 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:37.967045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 392/782] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:37.973573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 391/783] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:37.988102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700eb-705a-4fef-a394-f8ce2a21c38e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:37.988546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700eb-705a-4fef-a394-f8ce2a21c38e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:37.988648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00700eb-705a-4fef-a394-f8ce2a21c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.025921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b00700eb-705a-4fef-a394-f8ce2a21c38e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:38.027161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b00700eb-705a-4fef-a394-f8ce2a21c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:38.124510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 393/784] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:38.263613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.343016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bc60-3bb6-4be0-90a9-321ff006ce60 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.343357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bc60-3bb6-4be0-90a9-321ff006ce60 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.343576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bc60-3bb6-4be0-90a9-321ff006ce60 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.345167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 394/785] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:38.353764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.354045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.354319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.383825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9db46-df49-471f-8f6f-cda4284821d2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:38.403730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:38.405201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:38.419354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:38.419995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.420273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.420546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.431195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:38.435943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:38.436874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:38.437741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 392/786] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:38.442792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.494124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:38.538541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 395/787] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 22 16:53:38.540820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.551783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40309f90-63d6-43a3-94be-a30fedd2c553 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:38.599611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:38.600123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:38.606972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.607277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.608401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.609075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:38.610133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:38.611671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:38.629823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 393/788] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:38.638023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.678631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60138bf4-903d-4a00-afc1-a24b735487b5 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:38.748586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:38.749233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.749515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.749794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.768261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:38.773111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:38.775078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:38.775948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:38.782122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 396/789] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:38.786182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.817516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d442f6-3e1f-47b4-b32d-450b961b0088 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:38.819426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:38.869841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:38.870891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:38.873961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:38.874449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:38.898181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:38.900383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:38.920442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:38.921468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:38.922380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:38.922380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:38.922380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:38.926315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 394/790] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:38.927195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:38.959707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d039b-a519-4868-89ef-86060b55ca7e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:38.970809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.002526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.003172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.003455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.003734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.004410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:39.004727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.006098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.015917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 397/791] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:39.020859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.054669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ae845-22ab-4fd1-9e44-ce7e16bc3d2f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.099412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.100773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.101298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.101868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.115443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:39.122579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:39.123777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:39.124834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:39.127718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 395/792] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:39.129044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.146855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440d2b-c916-4a3d-9e9e-91e8f2d070c5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.152002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.191777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.192624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.193078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.193495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.194815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:39.195788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.198538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.216183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 398/793] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:39.217339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.248733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c60121-1abc-40b7-a2ac-583373a641bf None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.257616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.289348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.290339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.290753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.291151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.304133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.306297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:39.323965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:39.325200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:39.326354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:39.326354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:39.326354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:39.332336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 396/794] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:39.332336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.356977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51f355-4b27-4f33-8231-b162602e890a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.394170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.394690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.395071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.395354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.396082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:39.396411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.397773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.407808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 399/795] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:39.409305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.418187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.457242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1a260-cc09-42d5-a5bd-cb2c622336ce None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.494775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.495423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.495711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.495980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.504012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.505442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.509666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.519172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028368c-08eb-4c5e-9166-ce569cd3b1f7 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d21e0853-f154-4436-b787-1234e948e8d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:39.519854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:39.520789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:39.521749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:39.526347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 397/796] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:39.527631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683846e2-0e69-4d5e-9318-3bd1f1d307e1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.527920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683846e2-0e69-4d5e-9318-3bd1f1d307e1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.528197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683846e2-0e69-4d5e-9318-3bd1f1d307e1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.529699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 398/797] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:39.530667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683846e2-0e69-4d5e-9318-3bd1f1d307e1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.562558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.563196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.563474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.563746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.564381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:39.564684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.566042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.578385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 400/798] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:39.583336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.640876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683846e2-0e69-4d5e-9318-3bd1f1d307e1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.670009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.682932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.683560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.683845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.684119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.688742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301fa24-69de-4c93-bf75-19068f11a520 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.695866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.697298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-2ecd3341-d006-4615-8156-13f03fe1fe87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:39.711723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:39.712685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:39.713601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:39.713601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:39.713601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:39.717433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 399/799] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:39.718637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.718942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.719213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.725977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.727276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.727775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.728077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.728857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:39.729164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.730588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.737879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:39.739097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:39.754318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 401/800] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:39.754318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.766156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:39.822710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 400/801] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:39.822710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.871429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834cfb-3f62-41ab-a13f-4ce9e2fb5169 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.922403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:39.922949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:39.923238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:39.923519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:39.937873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:39.940503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:39.959184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:39.960381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:53:39.961943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:39.962639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082121a-a29e-4b0a-abb8-7645b4b31599 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:39.965185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 402/802] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:39.966187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:39.976159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.012705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.014096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.014533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.014971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.016369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:40.016828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.019127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.036122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 401/803] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:40.037393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.045994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.084057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169535e1-f1a5-4128-98ca-a2bc1c445d28 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.119690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.120327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.120610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.120883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.131687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.133686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.145227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4de8bc-e8e0-4382-9526-3483f3101a34 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-7616c55d-058e-4542-8701-24c802cb6817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:40.147412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:40.148637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:40.149695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:40.149695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:40.149695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:40.149695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 403/804] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:40.150243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3676f5-e775-4e8b-add1-2544fbe75d0d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.150345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3676f5-e775-4e8b-add1-2544fbe75d0d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.150613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3676f5-e775-4e8b-add1-2544fbe75d0d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.156397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 404/805] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:40.156397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3676f5-e775-4e8b-add1-2544fbe75d0d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.182942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.183478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.183756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.184026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.184742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:40.185040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.186487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.204804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 402/806] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:40.205601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.233145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.256506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3676f5-e775-4e8b-add1-2544fbe75d0d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.278861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.290620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.291278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.291561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.291836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.299083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.300511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.308513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7765-1424-492a-84f1-8ba748287cec None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:40.312159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:40.313275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:40.314416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:40.317971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 405/807] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:40.318626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.343108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.344068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.344360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.344637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] PATH_INFO: `/v3/services/network` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.345221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.346593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-78fa51b8-fb03-47c0-93d7-e7afef578dcd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:40.355250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:40.356480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:40.357336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 403/808] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:40.358150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.358150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.358440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.377655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:40.378932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:40.419661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82fecd-0d01-49bf-a85d-a9d6388f74b0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.445205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 404/809] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:40.445963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.461963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.462566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.462882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.463162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.463801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:40.464113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.465488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.467616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.477905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 406/810] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:40.479825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.529735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.553295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9fc35-df5a-406a-89df-80f18466e969 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.590177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.590366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fa4a-6379-4860-9616-7d7d8c705ecc None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.590819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.591105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.591377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.623735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.624345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.624629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.624905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.625638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:40.625951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.627405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.645884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 407/811] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:40.646721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.668405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.670265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.693634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.783015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 405/812] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:40.783975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.869822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.873312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657c111-20a6-400c-a93f-b30b257cc7f9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.887472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f28e3-5135-4e5a-b71a-6458d8f5c9a3 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:40.908182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.908372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:40.909229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.909447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.909658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.910286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] RBAC: Adding query filter params (name=network) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:40.910593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.911979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.917359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 408/813] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:40.918182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:40.925562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:40.926188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:40.926465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:40.926767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:40.933847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:40.935312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:40.946470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:40.947646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:40.948726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:40.952443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 406/814] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:40.953042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.020759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefa4e5-28a2-4af0-baf8-dcc1049a080d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.053377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460caa6-ebb4-43af-87d9-3abca0dd9dee None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.056692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.057314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.057594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.057866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.068301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.069738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:41.083559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:41.084572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:41.085496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:41.085496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:41.085496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:41.085496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 409/815] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:41.085496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.092002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.092634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.092910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.093181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.093762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.095152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:41.104197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:41.105249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:41.106086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 407/816] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 22 16:53:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:41.106933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.110849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.153448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.197374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f7a1-2897-44a2-b91a-f7f8d14c7d80 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.208236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7366c-dbff-44b7-b905-2f3dc35c9649 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.230769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.231396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.231673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.231944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.241960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.242172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.242899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.243184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.243455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.243563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.244072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] RBAC: Adding query filter params (type=network) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.244375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.245728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.250279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 408/817] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.251075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:41.257439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:41.259136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:41.260528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:41.260528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:41.260528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:41.260528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:41.260528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.329226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.351772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664fc1-9eb3-4170-8b5d-2224a7f71e2d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.360494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.363624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3aa3d-b4ea-48c0-a4de-02d1e3f397fa None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.386923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.387525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.387802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.388071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.388744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.389044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.390458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.397604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.398202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.398528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.398841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.399471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.399773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.401121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.402531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 409/819] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.403192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.412971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 411/820] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.413751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.509825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c079-c7c4-45bb-bd1b-098e51b44ebd None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.510026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae79e2-e5d0-487e-bb06-9d33f05d9d91 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.537895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.545690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.546304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.546435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.546622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.546882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.547067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.547349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.547503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.547652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.547798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.548311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.549171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.549660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.553471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.554365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.576477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 412/822] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:53:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:41.577728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.606797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.689260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6655-aaee-4db3-b358-6b445fe66d2f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.699184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39c81-5213-4a1e-b7f9-9256bd1c2266 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.728901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.729520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.729797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.730068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.730745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.731048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.732437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.738438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.739149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.739435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.739715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/12e995aeb6d440808a86ca23585ffdf0/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.741658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=12e995aeb6d440808a86ca23585ffdf0, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.743412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.749793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 411/823] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.749793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.763003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 413/824] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:41 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/12e995aeb6d440808a86ca23585ffdf0/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:41.764492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.814698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.880452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:41.894922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f210c17-ecdb-443e-b51f-3d3c89d5e37c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.902545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0b8d-5274-43de-b2f6-a7163cdbeadd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:41.940863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.941485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.941773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.942049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.942718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:41.943087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.943711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:41.944345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:41.944444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.944621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:41.944889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:41.951340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 414/825] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:41.951511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:41.958774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:41.960698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:41.975348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:41.976269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 412/826] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:41.980966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:42.074989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccabc81-2c64-4be7-974f-26d4e6c8c012 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.077518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:42.088104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7fc76-a06b-4732-be11-c18cd2dbf325 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.116268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.116899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.117240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.117571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.124203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.124383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.124817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.125096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.125369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.125816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.126076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.127506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:42.138172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:42.139113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:42.140043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:42.144190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 415/827] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:42.145024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:42.154014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 413/828] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:53:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:42.154861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:42.169205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:42.296780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18341f2-0941-4df3-9dff-21f553f572ee None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.300703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6cbae-200e-4201-88ec-d5fdebeaa007 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.340765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.341385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.341669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.341946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.342649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:42.342990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.344439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.347553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.348172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.348453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.348727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.349430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:42.349738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.351509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.363292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 416/829] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:42.364600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 414/830] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:42.371695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:42.375085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:42.408218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:42.450525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:42.500462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710860f-f79d-46e9-aa47-2788bb0b8bd5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.512792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e86b49-a47c-4a33-8ddc-898ef700d6ce None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:42.546865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.547963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.548376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.548665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.549394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:42.549706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.551876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486be213-fe51-425c-af42-07b0f089fa97 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.560020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:42.560631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 415/831] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:42 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:42.561336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:42.561693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:42.562057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bbff8baec7248ecbffe330a168cab5a/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:42.582076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=8bbff8baec7248ecbffe330a168cab5a, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:42.583730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042da77-f82a-43b9-bd77-b29134c30f61 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:42.600652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 417/832] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:42 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bbff8baec7248ecbffe330a168cab5a/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:53:43.972896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad8a6-a615-4d3f-acf5-73a7d120fddc None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:43.973457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad8a6-a615-4d3f-acf5-73a7d120fddc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:43.973457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad8a6-a615-4d3f-acf5-73a7d120fddc None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:43.975035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 416/833] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:43.980723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742139f2-6a5e-4bd4-9461-3f9b61259c06 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:43.981154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742139f2-6a5e-4bd4-9461-3f9b61259c06 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:43.981346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742139f2-6a5e-4bd4-9461-3f9b61259c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.000509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-742139f2-6a5e-4bd4-9461-3f9b61259c06 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:44.001680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-742139f2-6a5e-4bd4-9461-3f9b61259c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:44.069682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 418/834] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:44.347050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad8a6-a615-4d3f-acf5-73a7d120fddc None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:44.434901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1e30-dd5e-4c04-8af9-930cbeecd89f None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.435227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1e30-dd5e-4c04-8af9-930cbeecd89f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.435459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f1e30-dd5e-4c04-8af9-930cbeecd89f None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.436943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 419/835] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:44.441791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.442080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.442358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.450176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:44.454721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad8a6-a615-4d3f-acf5-73a7d120fddc None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:44.467238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:44.468914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:44.484138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:44.493170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:44.493804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.494083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.494351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.505396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:44.511109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:44.512080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:44.512941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 417/836] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:44.518263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:44.571065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 420/837] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:44.634428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae576-0a4f-48de-9cfc-895c25367aea None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:44.674152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:44.675064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.675487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.675903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.676757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:44.677221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:44.678778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444a51b-78e8-451a-8cd0-b411908ea85b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:44.688011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 418/838] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:44.693924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:44.811388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61631e54-3b49-4755-aa5f-42ac69385c88 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:44.856543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:44.857217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.857460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.857733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.859698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:44.861689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2def-8f0a-4a07-b30b-6a89c326445d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.862025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2def-8f0a-4a07-b30b-6a89c326445d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.862303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf2def-8f0a-4a07-b30b-6a89c326445d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.864080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 419/839] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:44.865285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9d8e-9dcd-4e8d-a1f6-5eada9a61a99 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.865575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9d8e-9dcd-4e8d-a1f6-5eada9a61a99 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.865851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9d8e-9dcd-4e8d-a1f6-5eada9a61a99 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.868557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 420/840] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:44.869749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.870057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.870325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.873680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:44.875190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:44.889987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-7938b9cc-e53c-41bf-b7b3-16f3e0619e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:44.890731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:44.891716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:44.892633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:44.892633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:44.892633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:44.892820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:44.892891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 421/841] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:44.893182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:44.893496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:44.893727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:44.911843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:44.913017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:44.942049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:44.965774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 421/842] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:44.967056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:44.989228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 422/843] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:44.990084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.086068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed874ff-2b95-4712-b65d-9f5f503d1c97 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.098013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6cabc-0a81-438e-957f-85ba1ead6fb6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.115696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.131377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.132355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.133394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.133917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.134851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.136202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.136774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.136893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.137074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.137345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.137985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.138279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.139758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:45.147754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:45.148850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:45.149739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.152640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 422/844] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:45.158702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 423/845] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.158843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.158950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.219771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.276948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e24d8-0173-49ce-82a8-705f77063e4e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.279103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741257a-87e9-4b08-9d4d-b34c8335f183 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.311444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.312071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.312353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.312448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.312624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.313001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.313279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.313548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.314169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.314472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.315856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.319988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.320135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 424/846] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.321240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.321436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:45.333812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:45.335021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 423/847] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:45.336528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.367563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.427005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f0af-1240-4994-a0e1-a1ce48b673d0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.433954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27cd4-9ab2-4ce2-9522-5d0277e13b85 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.436213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.465364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.465990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.466273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.466550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.468541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.469163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.469440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.469711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.470286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.471667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.477250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:45.481343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:45.486744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:45.487730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:45.488502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:45.489350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:53:45.490194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:45.490859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 424/848] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:45.490929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 425/849] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:45.491012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.491085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.585605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.589460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef52bf6-8a9b-4df8-aa09-01385bf0e467 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.589585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6566e5-445b-4855-8033-0596ded2e580 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.623068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.623337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.623666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.623940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.624042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.624214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.624305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.624483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.624937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.625104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.625246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.625410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.626694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.626788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.631172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 425/850] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.631986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.652558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 426/851] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.652820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.675598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.758744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8fa2-fc07-4fab-a7c7-8154d00c8143 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.772843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16de8b1-e3b8-4cc0-8904-2cfc22a18ed9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.799202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.799816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.800099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.800370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.800997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.801299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.803387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.809735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 426/852] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.810609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.812064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.812673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.812954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.813230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.813899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.814206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.815606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:45.826057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 427/853] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:45.826394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:45.850936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.921657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:45.928646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae53e2-1e01-4cde-87e1-9fc1ee3f38a6 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.942980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433406f5-3888-4321-b670-0fcd5623f83e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:45.964890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.965505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.965787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.966060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.981618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:45.982573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:45.983603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:45.983858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:45.984998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:45.985314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:45.986902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.002705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 428/854] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:46.002705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.062197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.063664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.111232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.132213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771244d-6e3a-472b-a64a-503256bce2a1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.174846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.175521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.175807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.176086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.188316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.190365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.190834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.197637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 427/855] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:46.203421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:46.213122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:46.214161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:46.215132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:46.215132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:46.215132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:46.215132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 429/856] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:46.219568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.330137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca20ba-4c36-4a66-a5fe-2e2ec8c1c3e7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.333991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcc751-2eff-4b2a-a3d9-56346c6a5cc1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.372687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.373311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.373590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.373860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.380718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.381629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.382120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.382640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.383906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:46.384526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.386163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.386468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.387947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.390185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.402712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 430/857] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:46.408605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:46.416028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:46.417015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:46.417975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:46.417975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:46.417975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:46.417975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 428/858] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:46.422645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.482098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.538548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8227-a5a9-48ab-b01e-23afd1ecb3d6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.547031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d08e-1169-4232-a921-37fa3c809777 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.585390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.586743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.587235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.587517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.591407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.592263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.592747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.593237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.594083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:46.594885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.595284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.596682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.596809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:46.609268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:46.610252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:46.611272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:46.613187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 429/859] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:46.614791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 431/860] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:46.618218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.622110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.685289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.734374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bffb6-bb4a-4bff-8cf3-df86f94116ae None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.742288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d333-5a1a-44b8-8416-cbd12727fe4a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.753649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.775065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.775787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.776185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.776532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.777345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:46.777751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.779549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.784687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.785524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.785953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.786460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.795778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.797449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:46.806817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 432/861] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:46.807817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:46.811110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:46.812047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:46.812993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:46.815285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 430/862] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:46.821465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:46.948268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872636b-3556-44bb-8058-17ecb144ca46 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.952952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454934ef-58b3-4cb0-8c60-8ee22c06f9ae None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:46.966752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:46.992149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:46.992766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:46.993048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:46.993322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:46.994095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:46.994315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:46.995772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.005921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.007152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.007687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.008179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.013681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 431/863] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:47.015577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.047314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:47.096697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.099142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.134471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc386fb-aefa-461b-84d3-f4025bcf4a64 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:47.174824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.175685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.175799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.175991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.176763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=12e995aeb6d440808a86ca23585ffdf0) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:47.177015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.178434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.191572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 432/864] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/role_assignments?user.id=12e995aeb6d440808a86ca23585ffdf0&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:47.221925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 433/865] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:47.227996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.338872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:47.348517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efb95-94da-4bf1-8ae9-889aee98a165 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:47.387040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.388056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.388540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.389030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.403031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.404789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:47.423394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:47.424390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:47.425299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:47.425299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:47.425299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:47.425299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 433/866] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:47.428258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.444845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:47.536771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf797-a2a5-492e-a78f-b5a4894d4b54 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:47.575009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.575627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.575968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.576245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.576938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:47.577248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.578620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.594605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 434/867] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:47.596573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.702769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f5cb9-b9ea-43cb-aae3-6c9a52b82276 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:47.739508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.740585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.741068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.741544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.751813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.753653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e0a90bd1-9cf6-4588-8fc0-f83908f488eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:47.767218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:47.768196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:47.769096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:47.771617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 434/868] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:47.777610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.857449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4982e4-cf5d-4071-bad4-6381203362ee None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.857651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4982e4-cf5d-4071-bad4-6381203362ee None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.857917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4982e4-cf5d-4071-bad4-6381203362ee None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.859572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 435/869] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:47.864813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:47.865783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf16b6-123f-4870-b54b-4856507717c3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.866271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf16b6-123f-4870-b54b-4856507717c3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.867838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf16b6-123f-4870-b54b-4856507717c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.878731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:47.893635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34d5d-bcbd-496b-8607-91d77086f44b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:47.895718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-84bf16b6-123f-4870-b54b-4856507717c3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:47.897981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-84bf16b6-123f-4870-b54b-4856507717c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:47.940224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:47.941188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:47.941653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:47.942102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:47.943031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:47.944068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:47.945966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:47.964331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 435/870] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:47.970059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:47.978680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 436/871] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:48.087125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7c65-bffc-44a3-9a7f-9badcddf1cdb None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:48.129380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:48.130160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:48.130547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:48.130983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:48.131806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bbff8baec7248ecbffe330a168cab5a) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:48.132194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:48.134310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea9089-a3cb-48db-b836-21d131dff084 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:48.136476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:48.143177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 436/872] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:47 2022] GET /identity/v3/role_assignments?user.id=8bbff8baec7248ecbffe330a168cab5a&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:48.264075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12af-904e-45c7-adc2-0e0a5a7d979c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:48.264636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12af-904e-45c7-adc2-0e0a5a7d979c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:48.264636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f12af-904e-45c7-adc2-0e0a5a7d979c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:48.266202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 437/873] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:48.272010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:48.272294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:48.272552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:48.287672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f12af-904e-45c7-adc2-0e0a5a7d979c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:48.293877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:48.295387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:48.374081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 437/874] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:48.418466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f12af-904e-45c7-adc2-0e0a5a7d979c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:48.456320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:48.457187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:48.457621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:48.458105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:48.458928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:48.460473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5d5c7-5888-43b6-9223-7256e01a5924 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:48.464580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:48.478995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 438/875] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:53:48 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 16:53:48.653975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:48.762363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e058-efcb-458a-8ccd-a96868920752 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:48.791057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:48.806807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:48.807422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:48.807701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:48.807975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:48.808622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:48.810056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b0775-b866-4b4b-a26b-005f8cae3ac3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:48.827930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 438/876] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:53:48 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:49.546503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2901-9574-44ec-967e-56b48e279fdd None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:49.547082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2901-9574-44ec-967e-56b48e279fdd None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:49.547082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2901-9574-44ec-967e-56b48e279fdd None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:49.548667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 439/877] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:49.553989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:49.554754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:49.555037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:49.573976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:49.575174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:49.653653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 439/878] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:49.921540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2901-9574-44ec-967e-56b48e279fdd None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:50.029410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2901-9574-44ec-967e-56b48e279fdd None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:50.064309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:50.064945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.065227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.065503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.066084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:50.067485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:50.076524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:50.077630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:50.078596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 440/879] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:50.083811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:50.186685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c1991-19c0-474b-a4c0-59a55adf786c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:50.198832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:50.228248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:50.228868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.229192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.229471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.230097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:50.230399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:50.231883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555fc16-3fa9-40f4-83e2-fc58db172e9b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:50.237072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 440/880] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:53:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:50.242578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:50.305412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:50.348527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222eb42-0669-4b44-bb9d-95c046622e94 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:50.384323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:50.384937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.385218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.385491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.386118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:50.386421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:50.387823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59638-58ba-4b00-81c2-fff6cc7f7579 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:50.392762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 441/881] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:53:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:50.541657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4dfc-f186-4384-98df-d47345e9ccf1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.542229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4dfc-f186-4384-98df-d47345e9ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.542706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c4dfc-f186-4384-98df-d47345e9ccf1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.544601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 441/882] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:50.550761 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db7eb-e229-4109-97c9-3fc974b54bbd None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.551755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db7eb-e229-4109-97c9-3fc974b54bbd None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.552248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db7eb-e229-4109-97c9-3fc974b54bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.572539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-056db7eb-e229-4109-97c9-3fc974b54bbd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:50.574065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-056db7eb-e229-4109-97c9-3fc974b54bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:50.646061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 442/883] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:50.839542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a448-d360-48a3-982b-6ec939cfd731 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.840515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a448-d360-48a3-982b-6ec939cfd731 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.841006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a448-d360-48a3-982b-6ec939cfd731 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.842883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 442/884] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:50.848334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:50.848873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:50.849375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:50.868481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:50.869990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:50.920667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:50.922154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a448-d360-48a3-982b-6ec939cfd731 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:50.943916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 443/885] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:51.043553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a448-d360-48a3-982b-6ec939cfd731 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.078584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.079259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.079546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.079823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.091299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-ef9a3f5f-3221-4929-a58b-686b42de7bc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:51.096039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:51.097060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.097940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 443/886] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:53:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:51.103450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.109286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b5b8-dbd3-4bc0-8dcc-7a0c651ecf2d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.109574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b5b8-dbd3-4bc0-8dcc-7a0c651ecf2d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.109850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5b5b8-dbd3-4bc0-8dcc-7a0c651ecf2d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.112394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 444/887] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:51.117113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.117398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.117670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.136677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:51.137925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:51.171315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.218112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76bd60-5a4e-4062-81aa-f7c170ad5975 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.223926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 445/888] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:51.245260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.263962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.264574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.264852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.265122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.265780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:51.266084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.267474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.277245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 444/889] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:51.283239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.342529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.377479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72027b-743f-4645-8c85-9c97dd2e671c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.414217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b11d-ae68-40e8-a595-186e16430e3f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.415148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.415879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.416252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.416619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.417452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.418930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:51.428536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:51.430373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:51.431483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.437469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 446/890] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:51.439865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.464797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.465593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.465873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.466146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.478790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.479057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.481224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:51.497872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:51.498963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:51.499935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:51.499935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:51.499935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:51.499935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 445/891] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:51.504829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.568028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7216e-a71f-43f9-a713-ae475451afa9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.605410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.605944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.606223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.606497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.607155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:51.607461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.609072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.612455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.613902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 447/892] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:51.614710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.620864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3657a2-3694-4d48-9326-ba6e355d92a0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.659611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.660253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.660954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.661229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.661863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:51.662182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.665039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.678001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 446/893] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:51.679385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.723363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.733556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47868ed9-baf0-4c6b-afc9-a94bd82c3bd1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.768499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.769494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.769875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.770161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.770778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.772146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:51.782450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:51.783471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.785139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 448/894] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:51.786131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.793259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236e03f-6291-4067-a369-bc975ca46e9e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.830337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.830980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.831264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.831536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.832438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:51.832438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.833807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.844220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 447/895] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:51.844220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.865528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.900415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aa7a2-2554-4edf-bce8-3383cf6598d8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.935686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:51.936419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:51.936773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:51.937117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:51.944765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:51.946855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:51.950792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a29cf2-d66a-4acf-b300-9a6bd18ec2dc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:51.961198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:51.962185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:51.963210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:51.963794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 449/896] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:51.964326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:51.985104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:51.999675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.000339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.000568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.000843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.001474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:52.001777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.003186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.008186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 448/897] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:52.008970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.079493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0e90d-2396-40cb-9b30-6138f4ce8610 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.097294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.114028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf92d9b-10d3-4276-9dbc-dc501cf0a7a0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.116530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.117607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.118049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.118234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.118961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] RBAC: Adding query filter params (interface=public, service_id=d79dea1174164fbf91d3c11c5af5f3cf, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:52.119282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.120656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.130541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 450/898] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:53:51 2022] GET /identity/v3/endpoints?service_id=d79dea1174164fbf91d3c11c5af5f3cf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:52.130541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.156482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.157199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.157479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.157749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.158477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:52.158815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.160244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.183589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 449/899] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:52.183589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.218535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.240086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a80aad-6e7a-45d5-b2d5-fab4461b6ae5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.275562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.276174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.276456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.276731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.277356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:52.277663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.279066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.284309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 451/900] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:52.285090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.285824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf17f4-cb38-4643-9461-f82d89b077b2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.324463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.325077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.325360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.325655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.326234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.327636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.340886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 450/901] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:53:52.340886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.348968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.429267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bd8d-a84c-4d53-97f4-3100efd813d9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.464245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaedac-68f2-40be-83d1-dd7a6fa584ea None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.487647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.488661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.489161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.490278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.509187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.510481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.511042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.511855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.512240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.514772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] RBAC: Adding query filter params (interface=public, service_id=c6f02b859d454481a9de93fd47e039db, region_id=RegionOne) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:52.515382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.518494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.531796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 451/902] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/endpoints?service_id=c6f02b859d454481a9de93fd47e039db&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:52.540673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.588040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.590200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fee59-6886-4a6a-bf86-c26e0a9784f1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.621829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.660844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542e8bd-76a0-46ba-9f14-d83df8904393 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.699291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.700240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.700792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.701226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.701835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.703238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804a101-6c3e-4536-b8c9-26bebc5f5b17 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.704461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 452/903] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:53:52.705733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0bb2-9da6-472d-8355-5388958b1225 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.706023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0bb2-9da6-472d-8355-5388958b1225 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.706292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d0bb2-9da6-472d-8355-5388958b1225 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.707653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 453/904] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:52.711626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0bb2-9da6-472d-8355-5388958b1225 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:52.715623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 452/905] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 16:53:52.717198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.717673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.718147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.745422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:52.747112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:52.776081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:52.834917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 453/906] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:52.860666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d0bb2-9da6-472d-8355-5388958b1225 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:52.904199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:52.904818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:52.905097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:52.905622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:52.918848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:52.920311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:52.937291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:52.938290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:52.939258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:52.939258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:52.939258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:52.939258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 454/907] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:52.944371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:53.021905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:53.064278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc8896-061c-463a-a710-1da2ef9bef47 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:53.103373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:53.103989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:53.104269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:53.104539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:53.105180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:53.105483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:53.106929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:53.118109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:53.119445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 454/908] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:53.127805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:53.224380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:53.232718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082f9f-8b81-437b-bb14-3cb602f48617 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:53.253790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3114959-7829-4c2b-9af8-a1a25ff60ef8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:53.276395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:53.277254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:53.277698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:53.278560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:53.279429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:53.281702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:53.282378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:53.297263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:53.297971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:53.298260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:53.298590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:53.304246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 455/909] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:53:53 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:53.310308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:53.310308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:53.324250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:53.325302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:53.326317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:53.329038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 455/910] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:53.336842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:53.459626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e7c92-50a0-4745-b0bc-0ddd64d4e055 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:53.497516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:53.498125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:53.498405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:53.498698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:53.499394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:53.499693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:53.501130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4426209-914e-4df0-8f2d-0e7a50edffdb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:53.518835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 456/911] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:53.521856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:53.637747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb90c-df2f-4f74-b499-9bb186015142 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:53.675321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:53.675931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:53.676210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:53.676486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:53.677210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] RBAC: Adding query filter params (role.id=be155358df254bb18527ad2bac086bee, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bbff8baec7248ecbffe330a168cab5a) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:53.677516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:53.678967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec6ea6-4c67-41fa-b456-2842700aab55 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:53.685333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 456/912] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:53:53 2022] GET /identity/v3/role_assignments?user.id=8bbff8baec7248ecbffe330a168cab5a&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=be155358df254bb18527ad2bac086bee => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:54.610106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25c26-29c5-464e-9171-c3c1526dce36 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:54.610872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25c26-29c5-464e-9171-c3c1526dce36 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:54.610872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25c26-29c5-464e-9171-c3c1526dce36 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:54.612325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 457/913] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:54.618639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427a9e-b6a8-4954-9344-e0f45d8b5ef4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:54.618958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427a9e-b6a8-4954-9344-e0f45d8b5ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:54.619234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50427a9e-b6a8-4954-9344-e0f45d8b5ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:54.638018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-50427a9e-b6a8-4954-9344-e0f45d8b5ef4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:54.639222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-50427a9e-b6a8-4954-9344-e0f45d8b5ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:54.688117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:54.717135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 457/914] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:54.995198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda25c26-29c5-464e-9171-c3c1526dce36 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.012706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.030853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf67fc-3b00-4f97-a063-c3d456870466 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.031519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf67fc-3b00-4f97-a063-c3d456870466 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.032011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf67fc-3b00-4f97-a063-c3d456870466 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.033841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 458/915] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:55.039139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.039700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.040183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.059910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:55.061432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:55.115788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda25c26-29c5-464e-9171-c3c1526dce36 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.150787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 459/916] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:55.163838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.164996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.165491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.165958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.166778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.168466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:55.177910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:55.178941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 16:53:55.180659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:55.183348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 458/917] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:55.189313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.294003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6785db-2763-472b-a34d-0b68958c0dcf None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.303326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.330198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.330615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.330928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.331202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.331828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:55.332136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.333504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.339344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 460/918] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:55.344921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.423987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.435611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.461433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820de91-9da0-4dba-b91f-0346835a6735 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.497367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.498308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.498768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.499203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.500002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:55.500575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.502224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.513962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 459/919] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 22 16:53:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:55.515351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.553960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160aae0e-92d6-4756-95ae-221c41e2113b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.596118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.596760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.597042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.597317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.597903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.599437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:55.610691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:55.611703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 16:53:55.612624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:55.616916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 461/920] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 22 16:53:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:55.618420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.631618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9454-0c6f-4cfa-bc0f-8bd09ea812cc None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.661511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.671412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.672358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.672796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.673380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.674591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.676624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1264c0-77c7-4c72-b318-5b808bf5e8ee None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.687935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.706698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 460/921] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:53:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:53:55.706698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541870c6-fe26-4944-953c-057c57386a4c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.706698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541870c6-fe26-4944-953c-057c57386a4c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.706698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541870c6-fe26-4944-953c-057c57386a4c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.711339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 461/922] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:53:55.713172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac006-ebb4-4a6b-a14f-6fd9d7955ff7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.714907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac006-ebb4-4a6b-a14f-6fd9d7955ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.716048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ac006-ebb4-4a6b-a14f-6fd9d7955ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.742898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-648ac006-ebb4-4a6b-a14f-6fd9d7955ff7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:55.744501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-648ac006-ebb4-4a6b-a14f-6fd9d7955ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:55.744900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea17de-f886-4a9b-84c0-660edebd9482 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.799136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.800038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.800533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.800998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.802035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:55.802542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:55.804324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:55.822181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 462/923] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:55.823618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:55.850753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 462/924] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:53:55.921429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8339c-8800-4ded-9752-149bf4bbc9ae None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.921714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8339c-8800-4ded-9752-149bf4bbc9ae None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.922173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8339c-8800-4ded-9752-149bf4bbc9ae None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.923526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 463/925] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:55.928691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.928980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.929867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.946835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:55.949173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:55.950703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:55.953606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c30ad-4863-4778-a404-b6b0505bd514 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:55.996814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:55.998086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:55.998453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:55.998894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:55.999627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:56.000044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.001492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.007089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 463/926] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:56.013502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.045916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 464/927] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:56.122153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e633f-f29d-4e0c-a95a-070dbb6f2960 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.144842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.159111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.160086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.160547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.161007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.161843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.163492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.190319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 464/928] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:53:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 16:53:56.216908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.275033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e42a8-bbbb-4490-8fe4-2e61c32f5c8f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.323163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.323383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.323513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.323513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.323693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.324284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.325709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:56.339920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:56.341023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:53:56.341879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 465/929] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:56.347315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.350336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.455182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95b6-bd13-4e22-b564-84e2af618954 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.480309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479e4e-a992-4268-af26-1695b45f44c1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.491500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.492896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.493398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.493684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.502726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.505970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:53:56.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:56.512908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:56.513777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 465/930] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:56.519147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.528490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.529909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.530635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.531112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.531950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:56.532941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.535230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.543100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 466/931] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:56.550017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.621993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.653227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048224e-9d69-42c0-945c-88d52a0d0a18 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.689921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b0df6-02e5-4341-b3ba-e24f08b58543 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.695784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.696583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.696996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.697371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.698180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:56.698583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.700351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.709869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 466/932] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:56.715822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.746456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.747133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.747734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.748141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.749008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:56.749309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.750874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.758215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 467/933] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:56.763734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.816499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.843499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553698-5dec-49f5-9c5a-bc9afc391676 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.886377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abed38-3354-45f4-9343-1b95dbe5b47d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:56.893277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.894262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.894551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.894870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.905823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:56.910975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.912821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:56.930061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:56.931359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:56.932351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:56.932351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:56.932351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:56.934263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 467/934] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:56.934601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:56.935362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:56.935716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:56.936103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:56.937019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] RBAC: Adding query filter params (interface=public, service_id=ec25cc76e89e48f5a2a92b341133f326, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:56.937400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:56.938891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:56.939882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:56.945193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 468/935] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/endpoints?service_id=ec25cc76e89e48f5a2a92b341133f326&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:56.950762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.049142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b731-a6bf-4ee3-b1b1-14f6c233cd12 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.066213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c5464-a636-45bd-a160-9686e3bfa02f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.077459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:57.085294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.086943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.087376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.087822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.088656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:57.089136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.090683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.104044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 468/936] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:57.106336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.110716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.110716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.110716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.110716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.110716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.112167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.116308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 469/937] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:53:56 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:53:57.173565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:57.233862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae46d9-d2b1-4903-a0ca-5a8ecd44dddd None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.273710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.274731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.275173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.275597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.284398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.286079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:53:57.300220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:57.301228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:53:57.302227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:57.306786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 469/938] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:53:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:57.308407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.419460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f878-2dc9-4725-a075-34288db28b21 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.456153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.457120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.457606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.458084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.459083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:57.459626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.461603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.480617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 470/939] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:53:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:57.487744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.593763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e23850-157b-438e-baf1-7c1d38587d38 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.604942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:57.629903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.630546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.630856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.631127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.643285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.644735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:53:57.661386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:57.662505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:53:57.663551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:53:57.663551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:53:57.663551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:57.663551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 470/940] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:57.668523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.706360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:57.785589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad65bd5-9126-40b6-9fbd-e437f95dda19 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:57.826337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:57.827358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:57.827844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:57.828318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:57.829157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:57.829680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:57.831290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:57.844314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 471/941] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:57.852253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:57.954809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40054128-ba0f-4ea5-a7c5-415ec72d9d48 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:58.000142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:58.000781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.001123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.001402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.009190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:58.010645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-aaffd8ef-52e7-4ae6-a79a-dfc69c03f1c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:58.022290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:58.023271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:58.024358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.028218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 471/942] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:58.031815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:58.087112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23b8f-3c9d-4f38-b9af-aaa15bca9d4e None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.087447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23b8f-3c9d-4f38-b9af-aaa15bca9d4e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.087654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e23b8f-3c9d-4f38-b9af-aaa15bca9d4e None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.089270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 472/943] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:58.095549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.095833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.096024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.115976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:58.117280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:58.131965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:58.137043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:58.148884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37326-30f9-49c5-a511-0df7d8ee04de None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:58.185942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:58.186554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.186901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.187178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.187866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:58.188166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:58.189811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:58.206771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 472/944] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:58.206950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 473/945] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:58.208990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:58.320125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31c645-de66-4025-b04d-f27439af7e55 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:58.355739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:58.356331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.356615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.356892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bbff8baec7248ecbffe330a168cab5a/roles/be155358df254bb18527ad2bac086bee` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.359137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=8bbff8baec7248ecbffe330a168cab5a, role_id=be155358df254bb18527ad2bac086bee)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:58.360568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077450-276a-458c-a10a-6e2745e80401 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:58.374622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 473/946] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:53:58 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bbff8baec7248ecbffe330a168cab5a/roles/be155358df254bb18527ad2bac086bee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:53:58.505309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:58.624944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57ef84-8b61-4e1b-856d-348cff2c7cab None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:58.660538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1c31-87e6-4bd0-ae83-adf09f360e47 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.660886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1c31-87e6-4bd0-ae83-adf09f360e47 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.661105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1c31-87e6-4bd0-ae83-adf09f360e47 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.662592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 474/947] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:58.667052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:58.667669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.667948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.668218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.668852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:58.669246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.669742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.670238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.670344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:58.673010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING keystone.server.flask.common [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 16:53:58.689503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:58.691205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:58.692168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.sql.core [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 16:53:58.692168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 16:53:58.692168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [parameters: {'id': '701b0fbbb2f5426b8230a67bbcb80403', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 16:53:58.692168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81529) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 16:53:58.694125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 701b0fbbb2f5426b8230a67bbcb80403.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 701b0fbbb2f5426b8230a67bbcb80403. Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:53:58.702229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 16:53:58.703360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application yield resource Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise self.value Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application session.commit() Sep 22 16:53:58.704383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.flush() Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application compat.raise_( Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 16:53:58.705314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 16:53:58.706280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:53:58.708734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [parameters: {'id': '701b0fbbb2f5426b8230a67bbcb80403', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.711030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:58.712963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 701b0fbbb2f5426b8230a67bbcb80403. Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 474/948] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Sep 22 16:53:58 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:58.715177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:58.722894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:58.798857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 475/949] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:58.822724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e2e36-de95-4102-aa4b-29619a4bc9b5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:58.857962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:58.858638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:58.858953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:58.859152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:58.866180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:58.868931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:53:58.880479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:58.881434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:58.882500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 475/950] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:53:58.887315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:58.993569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705948e-5e2a-4698-9ab6-e29937c96310 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:59.029085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:59.029701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.029984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.030504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.031214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:59.031521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:59.032955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:59.046865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:59.050423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 476/951] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:59.089187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:59.172394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:59.212515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c970d-d948-43ff-87e6-8697d5e40173 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:59.249551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:59.250181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.250459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.250757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.251341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:59.252701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:53:59.261957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:53:59.263108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:53:59.263989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 476/952] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:53:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:53:59.270741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:59.383401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918cb1-c9ca-43ae-8f45-286b4aa1f41b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:59.420774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:59.421410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.421685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.421957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.422687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:59.422950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:59.424382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61145ef-1283-4362-bba9-7b1a1846fdf2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:59.430597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 477/953] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:53:59.436436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:53:59.549436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a070e-6cf2-420e-9869-8bbfa9eb296b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:53:59.561892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f584c9-795c-486d-aec5-7f8d732dc25f None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.562492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f584c9-795c-486d-aec5-7f8d732dc25f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.563022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f584c9-795c-486d-aec5-7f8d732dc25f None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.564825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 478/954] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:53:59.570779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.571298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.571774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.581584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:59.587543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:53:59.587898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:53:59.588184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:53:59.588462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:53:59.589103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:53:59.589413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:53:59.590837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:53:59.594723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:53:59.596152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:53:59.606696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 477/955] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:53:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:53:59.670117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:53:59.683205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 479/956] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:53:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:53:59.957829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:00.077174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc4912-7aaf-4650-8e8c-8cb251b9250c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:00.117370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:00.118392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.118911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.119412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.120214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:00.121785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:00.130892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:00.131951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:00.133444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:00.136202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 478/957] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:53:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:00.142692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:00.250225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5fa34-0e80-441b-bf74-2467f41b8241 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:00.286230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:00.286881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.287165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.287440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.288081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:00.288387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:00.290357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:00.295893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 480/958] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:00.301312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:00.367101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:00.407141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14155007-71ad-4406-804a-9a1f15a13d74 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:00.442436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:00.443091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.443373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.443651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.444285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:00.444590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:00.446047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1087-32ae-45c1-abcb-0b0b482c78f1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:00.451441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 479/959] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:00.457159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:00.521756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:00.573793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7d97-ae30-4a8e-81eb-221c5c0ec107 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:00.609790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:00.610401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.610706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.610988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.611671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:00.613042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb28f91-1703-4534-8a60-ddcab86806e0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:00.635308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 481/960] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:54:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:00.665875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d8a0d-2055-4182-ad6d-114ffcc4a569 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.666198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d8a0d-2055-4182-ad6d-114ffcc4a569 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.666426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d8a0d-2055-4182-ad6d-114ffcc4a569 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.668178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 480/961] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:00.673962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:00.674300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:00.674536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:00.698338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:00.699941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:00.785953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 482/962] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:01.064927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d8a0d-2055-4182-ad6d-114ffcc4a569 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.173611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d8a0d-2055-4182-ad6d-114ffcc4a569 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:01.199515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:01.210506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:01.211193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.211458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.211823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.227343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:01.232320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:01.233349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:01.234202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:01.236822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 481/963] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:01.243445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.286870 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:01.355149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c26a0-5982-4f6f-be2b-a411a98622d3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:01.395556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:01.396176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.396454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.396727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.397402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:01.397702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:01.399287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707485-d54e-4e68-a688-8583a88fdb38 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:01.408678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 483/964] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:01.414637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.491837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba890f6f-d0bb-4a84-b040-a09a30d45986 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.492245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba890f6f-d0bb-4a84-b040-a09a30d45986 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.492382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba890f6f-d0bb-4a84-b040-a09a30d45986 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.493835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 484/965] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:01.499252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716262-076f-405f-a84e-85107a021712 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.499792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716262-076f-405f-a84e-85107a021712 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.500287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716262-076f-405f-a84e-85107a021712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.520998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-0f716262-076f-405f-a84e-85107a021712 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:01.521326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508de66-e942-4cce-b9eb-dbcc0ac70b7a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:01.522935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0f716262-076f-405f-a84e-85107a021712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:01.559282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:01.560062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.560347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.560622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.573982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:01.575878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:01.593780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:01.595055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:01.596187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:01.596187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:01.596187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:01.598733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 482/966] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:01.601989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.612234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 485/967] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:01.645637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:01.716883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840aadb-541a-4f80-a8fb-d44eb29d0873 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:01.755933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:01.756928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.758007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.758744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.759668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:01.760160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:01.761698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72e206-50b5-43a8-945f-79517ebeb2ae None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:01.774905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 483/968] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:01.783188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f716262-076f-405f-a84e-85107a021712 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.816371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:01.841372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f85d-deaf-43eb-aa5c-81da7edc221d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.841680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f85d-deaf-43eb-aa5c-81da7edc221d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.841919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7f85d-deaf-43eb-aa5c-81da7edc221d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.843932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 484/969] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:01.850954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.851975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.852643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.874576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:01.877779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:01.899286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f716262-076f-405f-a84e-85107a021712 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:01.936480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:01.937119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:01.937644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:01.937755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:01.946491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:01.948228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:01.952247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 485/970] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:01.956063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:54:01.960618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:01.961791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 16:54:01.963115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:01.969351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 486/971] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:01.969351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:01.999451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.078607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3187c5-53b6-4d9d-aa1b-1a6a7fd12958 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.092285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.104584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ec8-ff79-40d2-9a69-32ca5667112e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.116336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.117596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.118095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.118399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.119238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.120793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.136809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.sql.core [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 16:54:02.136809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 16:54:02.136809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [parameters: {'user_id': '0c7a8fa4bfe74fdeb9807bec1453c246', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 16:54:02.136809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81529) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 16:54:02.144956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:54:02.145192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:54:02.146055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application yield resource Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application next(self.gen) Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise self.value Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application session.commit() Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 16:54:02.147083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.session.flush() Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application compat.raise_( Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 16:54:02.148614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 16:54:02.149523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application conn.query(q) Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application result.read() Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 16:54:02.152125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [parameters: {'user_id': '0c7a8fa4bfe74fdeb9807bec1453c246', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:02.153937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 16:54:02.155904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 486/972] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 22 16:54:01 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:02.161314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.162096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.162096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.162096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.162096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:02.162096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.163258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.181998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 487/973] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 22 16:54:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:02.187755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.265843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.280695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3284968-9e9f-4488-a468-74410f51482d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.292456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842a54b-4e96-45b2-804e-4a9e6525acf9 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.315787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.316552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.316840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.317110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.325610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.327268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.327480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.328096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.328378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.328715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:54:02.338959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:02.339950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:02.340911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 487/974] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:02.341528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.356167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.410061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.411751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.454369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad942d1-5e88-49f9-a5af-b51cc169d1a8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.490629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.491265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.491546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.492173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.492879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.494251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.514458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 488/975] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:54:02 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:02.515335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.517663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 488/976] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 16:54:02.523378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.533086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.612841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.669294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e0bbd-171b-4add-896b-da869c33ef51 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.691792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde49238-376b-46de-9592-ed1d95ffd6d1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.716803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.717426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.717708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.717983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.718712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:02.719025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.720470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.731357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.732004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.732285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.732560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.744330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.745798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.758413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 489/977] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:02.762441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:02.763518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:02.764461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:02.764461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:02.764461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:02.764461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 489/978] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:02.769567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.847755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:02.896055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649953de-f72c-47bc-a8cf-108f3f91383d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:02.936550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:02.937553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.938041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.938537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.939442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:02.940019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:02.941796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098084e-6758-45f6-ac4f-9077baf856a5 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:02.955643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 490/979] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:02.961443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:02.973078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946718d7-0557-45ff-8642-1f68389a8f63 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.973385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946718d7-0557-45ff-8642-1f68389a8f63 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.973639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946718d7-0557-45ff-8642-1f68389a8f63 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:02.978424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 491/980] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:02.981561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:02.982813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:02.982813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.004680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:03.006226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:03.099383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 492/981] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:03.102586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8e18-b1f4-4022-94d9-b8e0fd160a60 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.104269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:03.140941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.141578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.141873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.142154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.149154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.150626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:54:03.162287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:03.163375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:03.165051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 490/982] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:03.171499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.225828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:03.274671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc6fc-5b23-41ae-8841-1362301d3b26 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.308571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.309184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.309466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.309738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.310484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:03.310833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.312244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.324767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 493/983] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:03.330521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.378089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.438939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd72d1-70e7-405a-a406-f80c7725efef None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.472540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.473141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.473422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.473696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.474411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] RBAC: Adding query filter params (role.id=be155358df254bb18527ad2bac086bee, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bbff8baec7248ecbffe330a168cab5a) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:03.474747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.476932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.483101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 491/984] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/role_assignments?user.id=8bbff8baec7248ecbffe330a168cab5a&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=be155358df254bb18527ad2bac086bee => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:03.500671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fbb2a-e345-4a15-8de7-18d470372b88 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.517598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:03.543376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.544030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.544308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.544576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.545165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.546560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:03.556922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:03.558032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:03.558954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:03.563044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 494/985] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:03.564254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.595926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:03.679104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6ec4-9bd2-4c64-95aa-3d701f28b6d3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.715153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.715768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.716051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.716325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.716948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:03.717252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.718617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.723809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 492/986] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:03.730102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.833330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b726bb-f6fb-4be8-8a61-b49f8b0a1bac None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:03.867972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:03.868588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:03.868870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:03.869144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:03.869775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:03.870080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:03.871479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:03.881390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 495/987] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:03.883241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:03.978077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:03.993885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac8311-d460-49fa-94a7-8e17a8ad9749 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:04.028862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:04.029475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:04.029763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:04.030043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:04.031052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] RBAC: Adding query filter params (interface=admin, service_id=ec25cc76e89e48f5a2a92b341133f326, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:04.031368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:04.032734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53facb-663d-42db-932f-bc61ac6ad1d8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:04.042289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 493/988] 10.222.0.50 () {56 vars in 1249 bytes} [Thu Sep 22 16:54:03 2022] GET /identity/v3/endpoints?service_id=ec25cc76e89e48f5a2a92b341133f326&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:04.043587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:04.086177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:04.145229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc2b1f-1943-4fc5-b423-a773095fe1ed None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:04.180576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:04.181199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:04.181483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:04.181759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:04.182362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:04.183819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df61cc2-c2a1-444e-9bce-41ef9135b89f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:04.198690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 496/989] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:54:04 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:54:04.810266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69f3c-8975-4c3e-aaaa-0eeba6223e88 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:04.810843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69f3c-8975-4c3e-aaaa-0eeba6223e88 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:04.810843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69f3c-8975-4c3e-aaaa-0eeba6223e88 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:04.812306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 494/990] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:04.817494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:04.817782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:04.818052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:04.837363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:04.838889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:04.907992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 497/991] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:05.178980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69f3c-8975-4c3e-aaaa-0eeba6223e88 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:05.282868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69f3c-8975-4c3e-aaaa-0eeba6223e88 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:05.317899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:05.318959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.319451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.319953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.320754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:05.322279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:05.331778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:05.333056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:05.334117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:05.336700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 495/992] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:05.342235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:05.376831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:05.447489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a2b9b-778a-425a-a535-43368bf5b246 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:05.481795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:05.482399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.482694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.482970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.483583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:05.483884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:05.485245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:05.495361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 498/993] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:54:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:05.496573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:05.516808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:05.611499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93d74-17a9-41c3-b50d-0d3b1a9b7c37 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:05.645278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:05.645905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.646186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.646454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.647116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:05.647428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:05.649659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d22e62-4e92-4563-b33e-c2573c9bb3a1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:05.655587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 496/994] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:54:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:05.661384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:05.695619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92302-6aed-4862-a408-91f4a99c6fe7 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.695936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92302-6aed-4862-a408-91f4a99c6fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.696182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92302-6aed-4862-a408-91f4a99c6fe7 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.697935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 497/995] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:05.702611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.702937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.703228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.722055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:05.723279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:05.765024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:05.769543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ed6d-ec01-42e9-8cbc-37a6eb75d15d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:05.805113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 498/996] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:05.809613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:05.810223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.810501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.810804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.811499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] RBAC: Adding query filter params (interface=public, service_id=64a547067daf4bf69b6a226983b74e07, region_id=RegionOne) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:05.811804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:05.813157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:05.818813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 499/997] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:54:05 2022] GET /identity/v3/endpoints?service_id=64a547067daf4bf69b6a226983b74e07&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:05.824404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:05.840153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:05.931569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786172c-d194-45cc-8821-7cb063d0ca60 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:05.966674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:05.967216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:05.967497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:05.967767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:05.968370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:05.969736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:05.982770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 499/998] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:54:05 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:54:06.080023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:06.193698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ca561-bbad-457f-928a-b858914e2dc1 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:06.228519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:06.229381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.229811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.230236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] PATH_INFO: `/v3/services/image` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.230991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:06.232525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6a1b6846-fdc2-4fe7-87af-11f066fafb00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:06.242194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:06.243401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.244392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 500/999] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 22 16:54:06 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:06.250164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:06.334328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:06.359288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f4b1-3789-40ba-8d7a-207a2b698324 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:06.373941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cdfa8-d6dc-4eca-97ca-1b2d1c1558ef None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.374485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cdfa8-d6dc-4eca-97ca-1b2d1c1558ef None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.374485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cdfa8-d6dc-4eca-97ca-1b2d1c1558ef None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.375841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 501/1000] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:06.380955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.381248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.381528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.397448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:06.398116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.398399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.398702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.399337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] RBAC: Adding query filter params (name=image) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:06.399644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:06.401011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:06.403807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:06.405151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:06.406083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 500/1001] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:06.411535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:06.430967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:06.481580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 502/1002] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:06.521365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3a875-640c-4202-95b5-6db7230f8a19 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:06.557125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:06.557740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.558025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.558305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.559021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] RBAC: Adding query filter params (type=image) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:06.559336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:06.560699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:06.570738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 501/1003] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:06.756467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:06.858051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339516c9-077c-46e6-b3f7-8f64896ee7b9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:06.895155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:06.895792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:06.896069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:06.896345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:06.896921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:06.898419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:06.907595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:06.908581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 16:54:06.909449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:06.914749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 503/1004] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 22 16:54:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:06.916239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:06.920072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:07.025300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe507022-5abe-4220-a818-8a429833f5ed None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:07.061440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:07.062421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:07.062941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:07.063410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:07.064225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:07.064724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:07.066283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:07.071448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 502/1005] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:07.077138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:07.100218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:07.181418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801db042-4ec4-4ce0-acd7-2c740776c80e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:07.216382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:07.217363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:07.217842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:07.218327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:07.219185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:07.219701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:07.221266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619316c1-6120-4189-9a64-ffb2fb020409 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:07.227690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 504/1006] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 22 16:54:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:07.233020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:07.303263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:07.338452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7987a-5e64-4f6c-9e14-7f06bf11c4fb None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:07.372543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:07.373148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:07.373430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:07.373705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:07.374365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:07.375763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0042-fe5d-401b-a22a-d70673d3d178 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:07.398690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 503/1007] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:54:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:08.160221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab56b-1b09-4ac1-83b5-5157d0b89edb None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.160722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab56b-1b09-4ac1-83b5-5157d0b89edb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.160802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab56b-1b09-4ac1-83b5-5157d0b89edb None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.162245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 505/1008] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:08.167395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.167812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.168049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.186605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:08.187819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:08.262409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 504/1009] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:08.533054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ab56b-1b09-4ac1-83b5-5157d0b89edb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:08.622846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:08.643910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ab56b-1b09-4ac1-83b5-5157d0b89edb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:08.681635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:08.682271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.682552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.682857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.683438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:08.684853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-dd4d0a43-56db-4383-960d-f3f66dabeed2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:08.693661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:08.695266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:08.699540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 506/1010] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:08.703456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:08.734515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9d6a-89ff-4494-afd1-7728dd9b1c62 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.735102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9d6a-89ff-4494-afd1-7728dd9b1c62 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.735215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9d6a-89ff-4494-afd1-7728dd9b1c62 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.736604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 507/1011] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:08.742009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.742477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.742779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.761473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:08.762675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:08.763499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:08.810647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bce318-f8a4-4629-b0c2-2b2b9ae3e158 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:08.840081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 508/1012] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:08.846208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:08.846867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:08.847157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:08.847438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:08.848060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:08.848367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:08.849734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:08.859389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 505/1013] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:54:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:08.860624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:08.942717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:08.965661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30ffb-60a5-4afa-8ae0-f35c96d35b37 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:09.006302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:09.006949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:09.007805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:09.008080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:09.008707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:09.009012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:09.010388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:09.020031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 509/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 22 16:54:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:09.021197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:09.112505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:09.132774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5611c-20d1-4a31-bf51-969978b82af6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:09.151511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:09.171956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:09.172617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:09.172833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:09.173110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:09.173788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:09.175204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143a4f-37b8-4683-8400-897cdb4aab57 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:09.206690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 506/1015] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:54:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:09.237832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d11a-1ada-4470-b47a-11a34008f99e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:09.285560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:09.286327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:09.286605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:09.286970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:09.287634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:09.289880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2af27-e487-4222-8a40-1c2a67dd4469 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:09.301359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:09.316163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 510/1016] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:54:09 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 16:54:09.693840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c6897-0758-4b62-ac77-a5f8cf1adc12 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:09.694283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c6897-0758-4b62-ac77-a5f8cf1adc12 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:09.695163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c6897-0758-4b62-ac77-a5f8cf1adc12 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:09.696964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 507/1017] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:09.709073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:09.709416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:09.709663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:09.733203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:09.734400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:09.863535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 511/1018] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:10.136416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c6897-0758-4b62-ac77-a5f8cf1adc12 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:10.249683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c6897-0758-4b62-ac77-a5f8cf1adc12 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:10.286443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:10.287336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:10.287627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:10.287905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:10.289754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:10.291277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d210-4ed1-4b74-86c7-316c20294a96 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:10.293048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 508/1019] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:10.300074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:10.413781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f5b71-64ea-4aa2-aaeb-65eba1f6e4bb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:10.441231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:10.454938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:10.455554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:10.455837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:10.456113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:10.456769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:10.458202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff819-b135-4f30-9259-da887eea3655 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:10.490168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 512/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:54:10 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:11.573781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f43e-45a1-4f40-8a6b-cbe98863c23f None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:11.574341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f43e-45a1-4f40-8a6b-cbe98863c23f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:11.574341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f43e-45a1-4f40-8a6b-cbe98863c23f None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:11.575848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 509/1021] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:11.580853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:11.581283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:11.581445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:11.600180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:11.601571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:11.649595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5d9d-219e-47e0-8a3f-e13dd3d355d3 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:11.649978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5d9d-219e-47e0-8a3f-e13dd3d355d3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:11.650239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d5d9d-219e-47e0-8a3f-e13dd3d355d3 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:11.654709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 510/1022] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:11.657524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:11.657804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:11.658074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:11.674753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 513/1023] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:11.678349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:11.680059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:11.715431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:11.750506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 511/1024] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:11.955456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.032436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.069065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1127e65-d9f5-445c-9075-1cedf2eb88a2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.077702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.109940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.110703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.110986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.111256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.122311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:12.127019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:12.128176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:12.129337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 514/1025] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:54:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:12.134686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.139997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90011c2-f686-44c1-aa21-33edded3f137 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.178437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.179149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.179433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.179708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] PATH_INFO: `/v3/services/image` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.180299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.182062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:12.191349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:12.192540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:12.193575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 512/1026] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:12.198933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.234103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.251444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe397-1ec1-471a-9d51-2dc1a3e96837 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.288033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.289825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.290285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.290744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.291554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:12.292447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.293970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.306539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b60a4d-2f2a-4658-a9b1-e01d20c6c6fe None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.307497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 515/1027] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:12.309033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.340132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.343707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.344269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.344556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.344844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.345467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] RBAC: Adding query filter params (name=image) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:12.345771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.347462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.357963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 513/1028] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:12.358886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.420957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f65c4-8f24-4997-8218-22fdf0ccd719 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.458957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.459596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.459874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.460681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.466231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.469414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007155df-c300-40b9-9b73-4d3eae8a0a4a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.473327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.474862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:12.490786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:12.491793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:12.492731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:12.492731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:12.492731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:12.492731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 516/1029] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:12.497909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.513734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.514647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.515024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.515378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.516013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:12.516425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.517689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.528205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 514/1030] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:12.529953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.593906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.619534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa169-4cb1-4398-b42d-d397b4323f81 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.637497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627789-9b2b-492f-ac98-dc8a787268b5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.664917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.665496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.665780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.666323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.666766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:12.667081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.668748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.674553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.675218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.675499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.675774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.676501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] RBAC: Adding query filter params (interface=public, service_id=4cbce18a0ee54d38b0dd21f028f26865, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:12.676817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.678242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.689065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 517/1031] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:12.689274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 515/1032] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/endpoints?service_id=4cbce18a0ee54d38b0dd21f028f26865&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:12.690048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.691445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.722735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.801150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622d93-46b6-4682-8698-fb3b56828322 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.803242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60ee47-b0f9-49b2-8ba6-365669d5dba7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:12.834124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.834757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.835141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.835954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.836558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.837897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:12.838022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56c07-6fec-41b7-b8d5-ada78a2906a5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.838521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.838838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.839111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.844301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 516/1033] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:54:12.845530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581e0c-cdca-4443-8931-686de486fbca None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.845822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581e0c-cdca-4443-8931-686de486fbca None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.846029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:12.846134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581e0c-cdca-4443-8931-686de486fbca None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.850693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:12.850893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 517/1034] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:12.853415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:12.853703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:12.853977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:12.861574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:12.875508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:54:12.875991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:12.876978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:12.877959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:12.878522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:12.878597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 518/1035] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:12.885859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:12.962925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 518/1036] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:13.038389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca24b3-4fd0-4b77-a9e7-492ec3f5756e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.084684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.086350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.086977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.087504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.088742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:13.089251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.092019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.129792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 519/1037] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:54:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:13.131151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:13.168660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:13.256601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af4f5b-1097-49ee-9b42-852eecc64a5b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.293602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.294238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.294514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.294819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.309414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:13.369058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.370542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.372818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:13.396541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:13.420345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da45356-e733-4f64-a3b9-8fdcc03e20f2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.458080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.458780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.459091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.459331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.460935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.462378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.467022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 520/1038] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:13.469739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:13.498783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 519/1039] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:13.504475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:13.593584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8325cd5-b45e-4500-87b6-891344c4e840 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.624194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:13.634908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630365-1892-46c1-b699-8ffa777fb395 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.636354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.637409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.637927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.638409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.639699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.641160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.669007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 521/1040] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:54:13 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:13.671202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:13.686805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.687474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.687753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.688034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.707246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.712773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:13.731347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:13.732433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:13.733350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:13.733350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:13.733350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:13.734158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 520/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:13.740946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:13.863956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7a7ec-79f1-4062-ad7f-513debea44a7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:13.903503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:13.904044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:13.904328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:13.904603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:13.905252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:13.905819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:13.907240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:13.919589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 522/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:13.925785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:14.040799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682ebf7-c755-4498-8466-8394d628a55a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:14.076420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:14.077059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:14.077341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:14.077616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:14.084690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:14.086731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:54:14.098432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:14.099547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:14.100477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 521/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:14.105858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:14.155247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:14.216005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce092ff-12ec-4f8b-b186-11b60a7121c2 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:14.253844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:14.254457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:14.254759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:14.255034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:14.255718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:14.256022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:14.258537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d15e-2fb1-41e9-85cd-61d87f1da45a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:14.276371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 523/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:14.277833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:14.318750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:14.398561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530160a8-a0e8-4e64-ad89-ab6245316834 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:14.442128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:14.442645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:14.443267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:14.443267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:14.443955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] RBAC: Adding query filter params (role.id=be155358df254bb18527ad2bac086bee, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:14.444263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:14.446567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723caef1-3883-4dd1-87c9-07aebbf3e68b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:14.452425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 522/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:14 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=be155358df254bb18527ad2bac086bee => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:15.177919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6b20-542a-484c-ab1b-7f1333e4bb5e None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.178472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6b20-542a-484c-ab1b-7f1333e4bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.179371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6b20-542a-484c-ab1b-7f1333e4bb5e None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.181811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 524/1046] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:15.186979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.187387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.187595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.207695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:15.208873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:15.283618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 523/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:15.563150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6b20-542a-484c-ab1b-7f1333e4bb5e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:15.674427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6b20-542a-484c-ab1b-7f1333e4bb5e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:15.675989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:15.712142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:15.712777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.713044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.713317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] PATH_INFO: `/v3/services/image` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.713887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:15.715271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:15.723938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:15.724959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 16:54:15.726370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:15.727796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 525/1048] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 22 16:54:15 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:15.731668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:15.759678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:15.832673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3f1b8-5a89-4c41-9419-5af015466142 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:15.872901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:15.873524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.873811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.874088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.874750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] RBAC: Adding query filter params (name=image) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:15.875059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:15.876440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b08aa6-e513-47e9-aa3a-95b504e31837 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:15.881458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 524/1049] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:15.887892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:15.953060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e9b1-e644-4e2e-9e34-eec3f7bedb01 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.953370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e9b1-e644-4e2e-9e34-eec3f7bedb01 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.953644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e9b1-e644-4e2e-9e34-eec3f7bedb01 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.955198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 525/1050] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:15.963610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597f32c-ad88-42de-905a-008a529429ec None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:15.964534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597f32c-ad88-42de-905a-008a529429ec None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:15.966415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597f32c-ad88-42de-905a-008a529429ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:15.996764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3597f32c-ad88-42de-905a-008a529429ec None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:15.996996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ac1bb-a1e9-4561-ac98-2c8efd5ae589 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:15.998119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3597f32c-ad88-42de-905a-008a529429ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:16.035700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:16.036644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.037100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.037563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.038628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] RBAC: Adding query filter params (type=image) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:16.039174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:16.040654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:16.046160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 526/1051] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:16.052470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:16.075072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 526/1052] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:16.091923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:16.166493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cab62f-8a93-474c-8ef3-19853c0a8c7d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:16.203596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:16.204236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.204492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.204753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.205421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:16.206816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:16.232503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 527/1053] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:54:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 16:54:16.360387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597f32c-ad88-42de-905a-008a529429ec None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:16.386708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:16.467856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597f32c-ad88-42de-905a-008a529429ec None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:16.508535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:16.509177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.509458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.509735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.521022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-691c9f6f-0eaa-4f7e-9e89-5684b839bfa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:16.526492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:16.528368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:16.529241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 527/1054] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:16.534605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:16.637148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:16.655976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e60-42a1-4283-9e9e-3e7f22fb560f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:16.691289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:16.692242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.692704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.693177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.694029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:16.694689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:16.696243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:16.698922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd806-7f72-46de-8e7f-ec13b7ce0fd4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.699214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd806-7f72-46de-8e7f-ec13b7ce0fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.699485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd806-7f72-46de-8e7f-ec13b7ce0fd4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.700808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 528/1055] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:16.705881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.706238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.706586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.711451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 528/1056] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:16.712696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:16.727739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:16.728934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:16.797538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 529/1057] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:16.819733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341446-bc77-4f75-881f-c940dfcc1c5b None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:16.860672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:16.863029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:16.863029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:16.863029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] PATH_INFO: `/v3/users/1708a30c243941c6b1b52f39654a1ce9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:16.879064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] RBAC: Authorizing `identity:get_user(user_id=1708a30c243941c6b1b52f39654a1ce9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:16.880465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:16.882437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 529/1058] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:16 2022] GET /identity/v3/users/1708a30c243941c6b1b52f39654a1ce9 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:16.889411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:16.903835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.011522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6474be0-6255-4e33-9966-76442a1fbb1e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.047202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.047816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.048093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.048363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.105708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.114596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.127401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.129317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.142563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.243766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ba42-cd88-482b-b9eb-85e1ef0492d4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.266165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 530/1059] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 16:54:17.267835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.295391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.296038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.296316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.296591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.308789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:17.317634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:17.318794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:17.320841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 530/1060] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:17.325364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.379961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabb83-47bc-42a4-824e-d4a8e7ffda38 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.390291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.407718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.421031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.421670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.421959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.422259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.423504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.425091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.430698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 531/1061] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:17.433960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.458016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67821a3-cd47-4f2d-aee7-701e945efe81 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.499292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.500153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.500748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.501203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.502582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:17.503058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.504585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.518636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 531/1062] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:17.520800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.561670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9d99a-6496-4ff2-85e3-57b2e6c087f1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.606507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00777904-6262-4381-a956-0ca705243d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.607314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777904-6262-4381-a956-0ca705243d65 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.607604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777904-6262-4381-a956-0ca705243d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.608704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777904-6262-4381-a956-0ca705243d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.609454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777904-6262-4381-a956-0ca705243d65 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=3c09cfada7db406184e1b573c6aa4660, user.id=1708a30c243941c6b1b52f39654a1ce9) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:17.609774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777904-6262-4381-a956-0ca705243d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.611906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00777904-6262-4381-a956-0ca705243d65 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.630792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 532/1063] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/role_assignments?user.id=1708a30c243941c6b1b52f39654a1ce9&scope.project.id=3c09cfada7db406184e1b573c6aa4660&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:17.647178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b014885-a6a6-4acb-b60c-b00f871918f9 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.688563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.699738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.700394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.700671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.701053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.716107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.717596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:17.735248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:17.736318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:17.737236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:17.737236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:17.737236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:17.737236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 532/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:17.743304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00777904-6262-4381-a956-0ca705243d65 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:17.792798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:17.867800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00777904-6262-4381-a956-0ca705243d65 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:17.909870 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:17.910494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:17.910810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:17.911088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:17.911737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:17.912046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:17.913460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:17.927556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 533/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:17.934984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.058914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b007c-6e6b-42bb-971f-72a7ab637635 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.093421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.094057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.094342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.094620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.102717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.104164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:54:18.115467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:18.117063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:18.118097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:18.121948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 533/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:54:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:18.123422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.228525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:18.231674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93099fdb-5106-4147-8b06-cc011bb7472d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.267640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.268166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.268448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.268725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.269454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:18.269762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.278697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.301593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 534/1067] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:18.303506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.348316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:18.409551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b35d43-1bf7-47ca-8242-a4f1068ac63d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.445999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.446694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.446978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.447251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.459657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.461736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-89c2ca07-6e1a-48d3-83b1-d64a7459c4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:18.478112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:18.479225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:18.480183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:18.480183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:18.480183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:18.482739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 534/1068] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:18.485318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.562431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f46b-9eae-4fd1-9d06-67812a5c4789 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.562620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f46b-9eae-4fd1-9d06-67812a5c4789 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.562927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f46b-9eae-4fd1-9d06-67812a5c4789 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.567030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 535/1069] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:18.569566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.569937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.570218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.592004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:18.592178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd986f56-f8d1-48a1-8a72-ae712871da47 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.593192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:18.629476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.630458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.630973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.631449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.632858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:18.633389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.634983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.647380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 535/1070] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:18.653153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.673510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:18.679120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 536/1071] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:18.765189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cbec4-107c-4a28-90ed-827b470418ed None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.799456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.800083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.800363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.800635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.807358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.808790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:54:18.820419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:18.821389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:18.822377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 536/1072] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:18.828623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.855412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:18.934097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dda5f-ee18-4a7e-ac24-0fb5007c0eae None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:18.945974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:18.974715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:18.975300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:18.975616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:18.975893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:18.976589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:18.976969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:18.978309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:18.996107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 537/1073] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:18.997131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:19.036769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:19.060026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b765b-a6a0-4b77-892e-be6267caa5c6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:19.083874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:19.095254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:19.095890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.096173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.096448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.105520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42970-c3e0-4533-b242-6a5ee1f7e912 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:19.139007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:19.139667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.139946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.140221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/be155358df254bb18527ad2bac086bee` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.142344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=8bddbf2c5a23405bb4ae9c56e9b17d08, role_id=be155358df254bb18527ad2bac086bee)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:19.143887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:19.158478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 538/1074] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:54:18 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/8bddbf2c5a23405bb4ae9c56e9b17d08/roles/be155358df254bb18527ad2bac086bee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:54:19.175647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:19.177144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:19.273056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:19.302699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 537/1075] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:19.305424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:19.411175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c98a52-0f8e-428d-9218-a49b88ef8301 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:19.446530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:19.447192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.447473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.447744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.458276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:19.459812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:19.462156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6fab5d7e-bcdc-4087-b9ff-ca030679eb72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:19.478565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:19.479828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:19.480760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:19.480760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:19.480760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:19.480760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 539/1076] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:19.486946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:19.587913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51fec5-9887-4501-a25d-915b2be7a9fd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:19.622032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:19.622645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.622955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.623225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.623856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:19.624159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:19.625522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c401-732c-46da-890c-6d63612dafe6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:19.644874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 538/1077] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:19.954934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae81e-0aca-40f7-b591-4b081a9b4db1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.955300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae81e-0aca-40f7-b591-4b081a9b4db1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.955482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ae81e-0aca-40f7-b591-4b081a9b4db1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.956826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 540/1078] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:19.963168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:19.963568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:19.963852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:19.982908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:19.984108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:20.013142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:20.052954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 539/1079] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:20.322448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae81e-0aca-40f7-b591-4b081a9b4db1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:20.422134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ae81e-0aca-40f7-b591-4b081a9b4db1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:20.455035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:20.455660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:20.455941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:20.456211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:20.467220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:20.471895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:20.472872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:20.474128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 541/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:20.479713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:20.575458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d1d1-2841-4d30-b7c9-18ff5559e7c8 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:20.608296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:20.608900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:20.609183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:20.609457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:20.610120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:20.610429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:20.611825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:20.620049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 540/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:20.625804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:20.681577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:20.726990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa49766-d955-4428-8b3b-5c1211070049 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:20.760452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:20.761079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:20.761360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:20.761635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] PATH_INFO: `/v3/users/1708a30c243941c6b1b52f39654a1ce9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:20.762780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] RBAC: Authorizing `identity:get_user(user_id=1708a30c243941c6b1b52f39654a1ce9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:20.764210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:20.765785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 542/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:20 2022] GET /identity/v3/users/1708a30c243941c6b1b52f39654a1ce9 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:20.771600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:20.809059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:20.887023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfeee1-75ad-4202-b9eb-986978a50a3b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:20.922867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:20.923508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:20.923793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:20.924070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:20.925178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:20.926610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a36c5-d1b4-47f3-8f8b-38ef86acd221 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:20.933586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 541/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:20 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:20.934768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:21.042117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d68fc-10b3-4bdd-8e09-0d337d21eed8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:21.065543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:21.078573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:21.079270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:21.079555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:21.079828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660/users/1708a30c243941c6b1b52f39654a1ce9/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:21.081728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] RBAC: Authorizing `identity:create_grant(project_id=3c09cfada7db406184e1b573c6aa4660, user_id=1708a30c243941c6b1b52f39654a1ce9, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:21.083317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1bec-228b-4728-bdbb-a6a3450c552f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:21.096761 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 543/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:54:20 2022] PUT /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660/users/1708a30c243941c6b1b52f39654a1ce9/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:54:21.361968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4758-0222-4c92-90c7-3038c1380246 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:21.362163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4758-0222-4c92-90c7-3038c1380246 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:21.362430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf4758-0222-4c92-90c7-3038c1380246 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:21.363785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 542/1085] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:21.369930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:21.370396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:21.370569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:21.390171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:21.391381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:21.457594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 544/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:21.730487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf4758-0222-4c92-90c7-3038c1380246 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:21.828745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:21.834055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf4758-0222-4c92-90c7-3038c1380246 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:21.868323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:21.868954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:21.869238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:21.869514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:21.880071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:21.885093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:21.886211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:21.887510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 543/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 22 16:54:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:21.892202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:21.994411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443ad75-b999-4e3a-b38b-d81c539660bb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.007472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:22.029299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.029904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.030187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.030743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.031398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:22.031704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.033056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.046578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 545/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:54:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:22.047767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:22.144023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbee73-64c1-4b78-8e55-49eadb6213a2 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.177740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.178373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.178684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.178972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.189412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.190880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:22.204763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:22.205754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:22.207102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:22.207102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:22.207102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:22.207102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 544/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:22.212094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:22.309692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2e1c-70ff-470a-bf79-ec13cbf67836 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.342716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.343333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.343617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.343891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.344532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:22.344845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.346211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.358607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 546/1090] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:22.364106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:22.376787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:22.464544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb7c9-129c-4c98-af3e-0f3b5a1913ae None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.497809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.498427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.498740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.499016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.506149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.508324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:54:22.519075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:22.520106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:22.521097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 545/1091] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:22.526793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:22.560054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:22.625393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee406-cd31-41c6-8e10-e90dd578fa46 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.658848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.659462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.659747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.660025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.660749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:22.661058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.662484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.680570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 547/1092] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:22.686409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:22.753323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:22.784784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc405a-1268-4c21-b5d2-6df7e0c777d4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:22.818070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:22.818591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:22.818896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:22.819239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:22.883970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:22.885414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:22.949848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:22.983428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 546/1093] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:22.989104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.081741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:23.091029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7745-d01a-4e58-bee6-01d72d1d8632 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.126320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.127013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.127298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.127574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.139785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.141272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-a3479b6b-866f-4fe3-be50-6b33870e2fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:23.158116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:23.159381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:54:23.160291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:23.160291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:54:23.160291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:23.160291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 548/1094] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:23.165362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.238921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772bb7-c2bf-4003-9bbc-2cd4dcd94d0d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.239227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772bb7-c2bf-4003-9bbc-2cd4dcd94d0d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.239501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772bb7-c2bf-4003-9bbc-2cd4dcd94d0d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.240847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 549/1095] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:54:23.246331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.246609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.246899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.265147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4c00-aa8f-42d1-8711-a8b0b96eaae2 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.265352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:23.266506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:23.298866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.299467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.299747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.300017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.300651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:23.300951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.302306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.313511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 547/1096] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:23.319672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.334218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 550/1097] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:54:23.349269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:23.416913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77be4-7ff0-45ac-a030-412fb4f6e960 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.451372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.451994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.452273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.452541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.459117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.461213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:54:23.472304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:23.473231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:23.474155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 548/1098] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:23.479248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.554546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:23.579904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166470d-bd64-4bc1-9316-9df452ab0e64 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.604883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.613649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.614255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.614931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.614931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.615522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:23.615843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.617873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.629321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 551/1099] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:23.635500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.698410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:23.708260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07a190-233d-4829-8a37-bff413789efa None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.736773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3da6c-67fa-45ff-97c2-315278467994 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.742347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.743005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.743289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.743562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.754480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:23.759876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:23.761011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:23.761896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 549/1100] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:54:23.767145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:23.771612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.772258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.772630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.772907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.773628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] RBAC: Adding query filter params (role.id=be155358df254bb18527ad2bac086bee, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=8bddbf2c5a23405bb4ae9c56e9b17d08) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:23.773938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.775399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.777214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:23.790889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 552/1101] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/role_assignments?user.id=8bddbf2c5a23405bb4ae9c56e9b17d08&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=be155358df254bb18527ad2bac086bee => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:23.873784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2615d2-a84b-4f27-9664-092f42112387 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:23.909679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:23.910302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:23.910582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:23.910947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:23.911670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:23.911972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:23.913412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:23.923062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 550/1102] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:23.930147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:24.038814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bf82b-26f8-41b0-a690-a962fc4e684a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:24.073124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:24.073755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:24.074038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:24.074315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] PATH_INFO: `/v3/users/1708a30c243941c6b1b52f39654a1ce9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:24.075516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] RBAC: Authorizing `identity:get_user(user_id=1708a30c243941c6b1b52f39654a1ce9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:24.076957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:24.078552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 553/1103] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:23 2022] GET /identity/v3/users/1708a30c243941c6b1b52f39654a1ce9 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:24.084470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:24.099561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:24.189011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bab80-d104-428a-b145-91b7142e94b5 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:24.223841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:24.224479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:24.224761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:24.225035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:24.296736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:24.298192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:24.312899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:24.398685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 551/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:24.404695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:24.472380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:24.509495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d165-799b-4c80-9d38-88adc2ecaf53 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:24.542996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:24.543632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:24.543916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:24.544194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:24.545324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:24.546787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392723b1-6577-4016-92c0-c78fb01fbcdc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:24.548637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 554/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:24 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:24.555148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:24.658416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022850-fb44-4f87-ad2b-c954158fe20e None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:24.673240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:24.693773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:24.694399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:24.694703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:24.694981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:24.695700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=3c09cfada7db406184e1b573c6aa4660, user.id=1708a30c243941c6b1b52f39654a1ce9) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:24.696006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:24.697417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a354c3-d62d-4554-900c-c5bbaa20fc17 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:24.702954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 552/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:24 2022] GET /identity/v3/role_assignments?user.id=1708a30c243941c6b1b52f39654a1ce9&scope.project.id=3c09cfada7db406184e1b573c6aa4660&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:26.873533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66f42-0a87-41e9-82a7-3e06806bac00 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:26.874072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66f42-0a87-41e9-82a7-3e06806bac00 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:26.874072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66f42-0a87-41e9-82a7-3e06806bac00 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:26.875478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 555/1107] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:26.880770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:26.881204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:26.881368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:26.899867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:26.901039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:26.964935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 553/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:27.237551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a66f42-0a87-41e9-82a7-3e06806bac00 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:27.339256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a66f42-0a87-41e9-82a7-3e06806bac00 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:27.371901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:27.372518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:27.372796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:27.373068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:27.374148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:27.375590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be49ba2-1e89-498a-941e-5ae7eeabc605 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:27.377122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 556/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:27.383318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:27.479540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab62c-9de4-44f0-be69-595d64b7deac None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:27.486523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:27.512568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:27.513097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:27.513378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:27.513653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:27.514290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:27.515752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbaa4a-e34f-4ee0-ae92-0b7582eee6be None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:27.536912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 554/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:54:27 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:29.715876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297680b-d412-408c-b58d-bc5e7ad4240c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:29.716432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297680b-d412-408c-b58d-bc5e7ad4240c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:29.716432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297680b-d412-408c-b58d-bc5e7ad4240c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:29.717741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 557/1111] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:29.723049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:29.723452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:29.723607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:29.742173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:29.743385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:29.808068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 555/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:30.079855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297680b-d412-408c-b58d-bc5e7ad4240c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:30.082758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:30.181116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297680b-d412-408c-b58d-bc5e7ad4240c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:30.213009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:30.213632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:30.213914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:30.214188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] PATH_INFO: `/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:30.215579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] RBAC: Authorizing `identity:get_role(role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:30.216949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:30.218248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 558/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:30 2022] GET /identity/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:30.223998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:30.312639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:30.321780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a74287-f6e9-4180-a4bf-6a75a2951639 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:30.354527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:30.355168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:30.355445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:30.355715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] PATH_INFO: `/v3/users/249d48f89a84406abd010771fa7752a9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:30.368858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] RBAC: Authorizing `identity:get_user(user_id=249d48f89a84406abd010771fa7752a9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:30.370292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:30.371895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 556/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:30 2022] GET /identity/v3/users/249d48f89a84406abd010771fa7752a9 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:30.377588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:30.446061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:30.475729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7285c3-cf4d-4986-86d1-e955ee5b313c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:30.508760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:30.509357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:30.509637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:30.509912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:30.574332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:30.575731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:30.640099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:30.670668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 559/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:30.676518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:30.772400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7b621-981f-476e-a1f9-afcc1731710f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:30.805800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:30.806413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:30.806716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:30.806990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:30.808083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:30.809495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fb7b1-656c-4a11-a651-7c8717f2f5ec None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:30.811110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 557/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:30 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:30.817175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:30.914110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69822c-6c1c-45a6-967b-7ee07ebd8309 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:30.947793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:30.948387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:30.948673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:30.948951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:30.949669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=3c09cfada7db406184e1b573c6aa4660, user.id=249d48f89a84406abd010771fa7752a9) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:30.949980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:30.951427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8ac56-d2f8-4bf3-926b-24d19048fd9f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:30.956712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 560/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:30 2022] GET /identity/v3/role_assignments?user.id=249d48f89a84406abd010771fa7752a9&scope.project.id=3c09cfada7db406184e1b573c6aa4660&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:33.058541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1608-4bc1-4c15-afb8-bcc7b3e50ab0 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.059067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1608-4bc1-4c15-afb8-bcc7b3e50ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.059184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1608-4bc1-4c15-afb8-bcc7b3e50ab0 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.060442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 558/1118] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:33.065713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.066121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.066263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.084814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:33.086477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:33.112183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:33.152482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 561/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:33.422965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1608-4bc1-4c15-afb8-bcc7b3e50ab0 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:33.442000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:33.523144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1608-4bc1-4c15-afb8-bcc7b3e50ab0 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:33.555922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:33.556539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.556823 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.557095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] PATH_INFO: `/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.558467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:33.559871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:33.561162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 559/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:33 2022] GET /identity/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:33.566971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:33.663165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70414e2-9db9-4c8b-bef3-e3b697d4e31f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:33.695806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:33.696368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.696647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.696918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] PATH_INFO: `/v3/users/249d48f89a84406abd010771fa7752a9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.698013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] RBAC: Authorizing `identity:get_user(user_id=249d48f89a84406abd010771fa7752a9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:33.699459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:33.701014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 562/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:33 2022] GET /identity/v3/users/249d48f89a84406abd010771fa7752a9 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:33.706684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:33.790904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:33.805859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a431b59-5e8e-4c0c-9cd2-9afac7feed80 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:33.839031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:33.839654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.839937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.840216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.841321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:33.842895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a5683-b2ff-49ba-8a49-fb7469a9831a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:33.844505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 560/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:33 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:33.850888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:33.880888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:33.948364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628edab-8b1d-43ba-98ae-a97ac5feb16e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:33.980735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:33.981385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:33.981663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:33.981936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660/users/249d48f89a84406abd010771fa7752a9/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:33.984095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] RBAC: Authorizing `identity:create_grant(project_id=3c09cfada7db406184e1b573c6aa4660, user_id=249d48f89a84406abd010771fa7752a9, role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:33.985512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21eb01-4d81-4247-bb9c-edcc050c775d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:33.998729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 563/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:54:33 2022] PUT /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660/users/249d48f89a84406abd010771fa7752a9/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:54:36.123083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49373-7a91-435d-aa3e-38b20be04ed1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:36.123632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49373-7a91-435d-aa3e-38b20be04ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:36.123632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac49373-7a91-435d-aa3e-38b20be04ed1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:36.124940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 561/1124] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:36.130025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:36.130410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:36.130574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:36.149365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:36.150519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:36.215082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 564/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:36.480104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49373-7a91-435d-aa3e-38b20be04ed1 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:36.577748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac49373-7a91-435d-aa3e-38b20be04ed1 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:36.611009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:36.611626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:36.611908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:36.612182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] PATH_INFO: `/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:36.613553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] RBAC: Authorizing `identity:get_role(role_id=c6e3ab1a108a4ad9bf291b4e73669809)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:36.614933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:36.616417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 562/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:36 2022] GET /identity/v3/roles/c6e3ab1a108a4ad9bf291b4e73669809 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:36.622148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:36.645323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:36.719966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9844929-5d55-4923-8328-dfa684ebcd7b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:36.753231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:36.753797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:36.754081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:36.754353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] PATH_INFO: `/v3/users/249d48f89a84406abd010771fa7752a9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:36.755491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] RBAC: Authorizing `identity:get_user(user_id=249d48f89a84406abd010771fa7752a9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:36.757097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:36.758671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 565/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:36 2022] GET /identity/v3/users/249d48f89a84406abd010771fa7752a9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:36.764364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:36.788783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:36.861995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d722c-7892-4c5b-95da-b72044608862 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:36.908764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:36.909372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:36.909655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:36.909931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:36.975207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:36.976667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:36.999290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:37.072428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 563/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:37.078363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:37.166996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:37.176413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72298f4-8040-45e8-8aa0-7a9da42a1523 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:37.208726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:37.209848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:37.210125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:37.210395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] PATH_INFO: `/v3/projects/3c09cfada7db406184e1b573c6aa4660` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:37.211525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] RBAC: Authorizing `identity:get_project(project_id=3c09cfada7db406184e1b573c6aa4660)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:37.212947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12347a-6603-4602-b637-ea5494015473 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:37.214557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 566/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:37 2022] GET /identity/v3/projects/3c09cfada7db406184e1b573c6aa4660 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:37.220599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:37.316883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486de59-77c4-4f66-b175-d1c25d1b0f8b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:37.339948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:37.352120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:37.352713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:37.352991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:37.353258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:37.353971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] RBAC: Adding query filter params (role.id=c6e3ab1a108a4ad9bf291b4e73669809, scope.project.id=3c09cfada7db406184e1b573c6aa4660, user.id=249d48f89a84406abd010771fa7752a9) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:37.354275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:37.355716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d52ba-7436-47a3-adca-95e91ea62e6e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:37.361150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 564/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:37 2022] GET /identity/v3/role_assignments?user.id=249d48f89a84406abd010771fa7752a9&scope.project.id=3c09cfada7db406184e1b573c6aa4660&role.id=c6e3ab1a108a4ad9bf291b4e73669809 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:54:39.509569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f6b1-e3bf-4dc8-8980-8e8be5b7d7d1 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:39.510148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f6b1-e3bf-4dc8-8980-8e8be5b7d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:39.510148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f6b1-e3bf-4dc8-8980-8e8be5b7d7d1 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:39.511469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 567/1131] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:39.516534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:39.516958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:39.517087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:39.535832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:39.537601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:39.603095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 565/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:39.873719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144f6b1-e3bf-4dc8-8980-8e8be5b7d7d1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:39.973156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144f6b1-e3bf-4dc8-8980-8e8be5b7d7d1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:40.006948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:40.007573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:40.007849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:40.008115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:40.009212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:40.010626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a029c1-bbab-438e-aeae-988e5e5b307e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:40.012192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 568/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:40.017960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:40.112321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bb7e4-ebc2-4644-9a61-09d2a8bb328f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:40.128187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:40.145840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:40.146472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:40.146783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:40.147060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:40.147695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:40.149107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643f99-f287-4558-b686-0da1cd81976e None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:40.173855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 566/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:54:40 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:42.336220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2b85-337c-4044-8bb1-1b1ff2e0dcd3 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:42.336724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2b85-337c-4044-8bb1-1b1ff2e0dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:42.336724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c2b85-337c-4044-8bb1-1b1ff2e0dcd3 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:42.338015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 569/1135] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:42.343375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:42.343775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:42.343935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:42.362334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:42.363566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:42.428852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 567/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:42.701020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c2b85-337c-4044-8bb1-1b1ff2e0dcd3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:42.729374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:42.803042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c2b85-337c-4044-8bb1-1b1ff2e0dcd3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:42.836123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:42.836747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:42.837027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:42.837300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:42.838392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:42.839840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c061-0d2f-448f-a39b-2748bd62cb51 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:42.841379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 570/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:54:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:42.847039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:42.939812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:42.944334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb0682-1f70-4816-9164-9fa0466e3c0b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:42.978295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:42.978863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:42.979151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:42.979426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:42.980080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:42.981531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d087b8-de4a-406e-b74f-d216124aa4b3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:43.002226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 568/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:54:42 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:54:45.180864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5e57-921f-457e-82e1-6d8ee6a880ae None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:45.181412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5e57-921f-457e-82e1-6d8ee6a880ae None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:45.181412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5e57-921f-457e-82e1-6d8ee6a880ae None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:45.182750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 571/1139] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:45.187918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:45.188312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:45.188481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:45.207055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:45.208244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:45.273336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 569/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:45.542276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5e57-921f-457e-82e1-6d8ee6a880ae None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:45.632311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:45.639665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5e57-921f-457e-82e1-6d8ee6a880ae None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:45.674013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:45.674626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:45.674934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:45.675205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:45.684963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:45.689643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:45.690778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:45.691746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 572/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:45.696858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:45.779038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:45.796238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d660-9fd1-47b5-83c6-98df0a5b2bad None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:45.830331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:45.830957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:45.831240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:45.831516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:45.832176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:45.832483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:45.834421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:45.842251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 570/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:45.848462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:45.946101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198180-3647-45be-ac91-4c235231aa4e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:45.979241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:45.979868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:45.980146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:45.980422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] PATH_INFO: `/v3/users/cdb476cf516543f6a6c132c790397357` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:45.993806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb476cf516543f6a6c132c790397357)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:45.995288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:45.996874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 573/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:45 2022] GET /identity/v3/users/cdb476cf516543f6a6c132c790397357 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:46.002614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:46.107022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fc63-909d-4015-85e9-79cc2c6776f3 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:46.140069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:46.140669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:46.140954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:46.141230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:46.156052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:46.207193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:46.208759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:46.303144 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 571/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:46.308839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:46.323963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:46.406427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202255b-0788-4c6a-b261-e7dd41dc8c13 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:46.439509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:46.440123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:46.440401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:46.440671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] PATH_INFO: `/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:46.441751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] RBAC: Authorizing `identity:get_project(project_id=1068b819327f4d7ea8ebefcda2ae3ba9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:46.444027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9fe2f-8fdb-4c82-9a2d-86b072c18794 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:46.445633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 574/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:46 2022] GET /identity/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:46.451624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:46.496863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:46.548151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f032e-d292-46cf-a299-f0d15c79d83b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:46.580619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:46.581212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:46.581493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:46.581767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:46.582481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=1068b819327f4d7ea8ebefcda2ae3ba9, user.id=cdb476cf516543f6a6c132c790397357) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:46.582822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:46.584408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f5010-4b29-40d8-8ea8-ccf652c2315a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:46.589554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 572/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:46 2022] GET /identity/v3/role_assignments?user.id=cdb476cf516543f6a6c132c790397357&scope.project.id=1068b819327f4d7ea8ebefcda2ae3ba9&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:48.700186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a223-0404-422d-8e0e-660ce242e5af None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:48.700724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a223-0404-422d-8e0e-660ce242e5af None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:48.700724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a223-0404-422d-8e0e-660ce242e5af None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:48.702064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 575/1147] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:48.707289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888209d0-9967-486e-9187-1cd48fb306de None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:48.707736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888209d0-9967-486e-9187-1cd48fb306de None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:48.707832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888209d0-9967-486e-9187-1cd48fb306de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:48.726844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-888209d0-9967-486e-9187-1cd48fb306de None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:48.728015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-888209d0-9967-486e-9187-1cd48fb306de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:48.792701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 573/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:49.064790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8a223-0404-422d-8e0e-660ce242e5af None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:49.144140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:49.164981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8a223-0404-422d-8e0e-660ce242e5af None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:49.198660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:49.199293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:49.199576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:49.199850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:49.209795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:49.214567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:49.215714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:49.216780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:49.218826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 576/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:49.221548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888209d0-9967-486e-9187-1cd48fb306de None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:49.262138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:49.318602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888209d0-9967-486e-9187-1cd48fb306de None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:49.350718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:49.351317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:49.351599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:49.351875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:49.352532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:49.352837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:49.354198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:49.361916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 574/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:49.368319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:49.466398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5489e-edcb-4e9f-8c1b-6e1ee79c533c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:49.506628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:49.507271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:49.507547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:49.507819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] PATH_INFO: `/v3/users/cdb476cf516543f6a6c132c790397357` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:49.508926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] RBAC: Authorizing `identity:get_user(user_id=cdb476cf516543f6a6c132c790397357)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:49.510332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:49.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 577/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:49 2022] GET /identity/v3/users/cdb476cf516543f6a6c132c790397357 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:49.517763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:49.615840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1349e9-b2ed-48ee-b2da-01cb8235dec8 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:49.617327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:49.650057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:49.650767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:49.651055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:49.651328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] PATH_INFO: `/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:49.652435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] RBAC: Authorizing `identity:get_project(project_id=1068b819327f4d7ea8ebefcda2ae3ba9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:49.653853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e0a71-e4b0-4157-9b09-21212bf43983 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:49.655801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 575/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:49 2022] GET /identity/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:49.661721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:49.672676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:49.758779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf6ae-9833-4a6f-b5ad-5b7a52050b7e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:49.791016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:49.791604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:49.791884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:49.792153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] PATH_INFO: `/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9/users/cdb476cf516543f6a6c132c790397357/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:49.793996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1068b819327f4d7ea8ebefcda2ae3ba9, user_id=cdb476cf516543f6a6c132c790397357, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:49.795431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ad8f2-e318-4e67-afe6-00ad95d3c4e4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:49.808922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 578/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:54:49 2022] PUT /identity/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9/users/cdb476cf516543f6a6c132c790397357/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:54:51.941542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e95a-08f1-4451-95f8-0e38107af12b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:51.942103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e95a-08f1-4451-95f8-0e38107af12b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:51.942103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277e95a-08f1-4451-95f8-0e38107af12b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:51.944118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 576/1154] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:51.949596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:51.949986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:51.950154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:51.968649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:51.969834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:52.031631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:52.038097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 579/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:52.316549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277e95a-08f1-4451-95f8-0e38107af12b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:52.416299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277e95a-08f1-4451-95f8-0e38107af12b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:52.449201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:52.449820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:52.450102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:52.450379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:52.460569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:54:52.465327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:52.466494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:54:52.467632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 577/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:52.472463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:52.570048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c1ee8-b74d-4cfd-8c0a-886d37cb46a4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:52.602848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:52.603446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:52.603727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:52.604028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:52.604682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:52.604987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:52.606350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:52.614166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 580/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:52.620638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:52.650103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:52.719093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b2f49-5175-4c62-8527-b3cf618ef941 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:52.751957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:52.752578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:52.752861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:52.753139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] PATH_INFO: `/v3/users/cdb476cf516543f6a6c132c790397357` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:52.754234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cdb476cf516543f6a6c132c790397357)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:52.755736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:52.757296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 578/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:54:52 2022] GET /identity/v3/users/cdb476cf516543f6a6c132c790397357 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:52.763168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:52.821666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:52.861378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b947-7925-47c8-ad52-8299e81ed733 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:52.893752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:52.894350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:52.894627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:52.894937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:52.960918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:52.962363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:53.018399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:53.060522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 581/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:53.066418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:53.159378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:53.163891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8a75-4c22-4b5e-8698-fce7089de6f2 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:53.195732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:53.196371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:53.196650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:53.196918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] PATH_INFO: `/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:53.198002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] RBAC: Authorizing `identity:get_project(project_id=1068b819327f4d7ea8ebefcda2ae3ba9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:53.199463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a1ad-d6ff-4202-a1ca-45cc5f9b899d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:53.201058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 579/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:54:53 2022] GET /identity/v3/projects/1068b819327f4d7ea8ebefcda2ae3ba9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:53.207174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:53.304248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a260-d129-41da-9afe-f64b6a7d0388 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:53.336346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:53.336932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:53.337211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:53.337479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:53.338184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=1068b819327f4d7ea8ebefcda2ae3ba9, user.id=cdb476cf516543f6a6c132c790397357) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:53.338488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:53.339918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a7ef2-1b46-465c-a754-3f7195250e68 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:53.345449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 582/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:54:53 2022] GET /identity/v3/role_assignments?user.id=cdb476cf516543f6a6c132c790397357&scope.project.id=1068b819327f4d7ea8ebefcda2ae3ba9&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:55.534365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e11-b654-4303-9494-062638e07768 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:55.534958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e11-b654-4303-9494-062638e07768 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:55.534958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e11-b654-4303-9494-062638e07768 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:55.536352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 580/1162] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:55.541969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:55.542409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:55.542510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:55.560689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:55.561870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:55.579533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:55.627846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 583/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:55.905106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88e11-b654-4303-9494-062638e07768 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:56.007027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88e11-b654-4303-9494-062638e07768 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:56.046397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:56.047017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:56.047302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:56.047573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:56.079542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:56.115478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:56.116913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:56.212532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 581/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:54:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:54:56.218446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:56.315699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a1d4-f6bd-4301-8dd8-e1cf9a6eae28 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:56.349463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:56.350084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:56.350367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:56.350643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:56.357137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:56.358580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-dc814724-86b4-48cf-b210-b520c6e44ba8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:54:56.369671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:54:56.370943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:54:56.372252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 584/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:54:56 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:54:56.376677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:56.438364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:56.472340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792ad5c-1921-4719-944f-5cd3f58c88cf None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:56.504335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:56.505547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:56.505825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:56.506095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:56.506747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:54:56.507049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:56.508396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee01ca-4d25-4b22-9239-cc9cf2d55f16 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:56.515162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 582/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 22 16:54:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:54:58.650824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156c8f-defa-44dd-8de7-c8f1b3ec1fed None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:58.651358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156c8f-defa-44dd-8de7-c8f1b3ec1fed None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:58.651358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad156c8f-defa-44dd-8de7-c8f1b3ec1fed None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:58.652723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 585/1167] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:54:58.658286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb762-dbc5-4a3d-9eec-cb2947a77973 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:58.658727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb762-dbc5-4a3d-9eec-cb2947a77973 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:58.658859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bb762-dbc5-4a3d-9eec-cb2947a77973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:58.676718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e11bb762-dbc5-4a3d-9eec-cb2947a77973 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:54:58.678067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e11bb762-dbc5-4a3d-9eec-cb2947a77973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:54:58.741946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 583/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:54:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:54:59.017902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad156c8f-defa-44dd-8de7-c8f1b3ec1fed None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:54:59.034128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:54:59.117759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad156c8f-defa-44dd-8de7-c8f1b3ec1fed None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:54:59.149955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:54:59.150548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:54:59.150857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:54:59.151131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:54:59.151781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:54:59.153144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52037e60-0030-476a-a920-d3bd42a9a420 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:54:59.168295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 586/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Thu Sep 22 16:54:59 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:55:01.323060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc00bf-c497-4b78-a0c4-36a299a11d57 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:01.323567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc00bf-c497-4b78-a0c4-36a299a11d57 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:01.323567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc00bf-c497-4b78-a0c4-36a299a11d57 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:01.324910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 584/1170] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:55:01.330032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:01.330468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:01.330580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:01.349870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:55:01.351080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:55:01.416630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 587/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:55:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:55:01.686269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc00bf-c497-4b78-a0c4-36a299a11d57 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:01.744948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:01.785236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc00bf-c497-4b78-a0c4-36a299a11d57 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:01.819281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:01.819895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:01.820172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:01.820443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] PATH_INFO: `/v3/domains/14b4524db88842e284ed34c22e1b1a34` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:01.830304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=14b4524db88842e284ed34c22e1b1a34)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:01.831760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80876-5e89-4c54-943f-fa049737fbc5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:01.834021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 585/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Sep 22 16:55:01 2022] GET /identity/v3/domains/14b4524db88842e284ed34c22e1b1a34 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:01.839770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:01.842879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:01.937509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe0863-1a78-4f41-8927-07a1448a31fb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:01.970223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:01.970852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:01.971139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:01.971417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:01.972067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:01.973663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494ab1-c589-4dfa-80be-5fcf93d12613 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:02.001455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 588/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:55:01 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:55:04.186644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327935-b2e2-4f61-b050-f34fb01c73cc None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:04.187205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327935-b2e2-4f61-b050-f34fb01c73cc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:04.187299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327935-b2e2-4f61-b050-f34fb01c73cc None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:04.188573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 586/1174] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:55:04.194078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:04.194516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:04.194628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:04.213187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:55:04.214371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:55:04.263268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:04.280669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 589/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:55:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:55:04.556002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327935-b2e2-4f61-b050-f34fb01c73cc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:04.655103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327935-b2e2-4f61-b050-f34fb01c73cc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:04.674853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:04.689821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:04.690442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:04.690759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:04.691035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] PATH_INFO: `/v3/domains/14b4524db88842e284ed34c22e1b1a34` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:04.692275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=14b4524db88842e284ed34c22e1b1a34)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:04.693698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433da2d-de5b-4a90-b07d-9d39794b3eb3 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:04.695280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 587/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Sep 22 16:55:04 2022] GET /identity/v3/domains/14b4524db88842e284ed34c22e1b1a34 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:04.701054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:04.797429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08750a-9e1a-438c-b59e-abb869e4e50c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:04.830526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:04.831091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:04.831376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:04.831651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:04.832313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:04.833729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c11f67-f02d-4810-866a-76245f93f754 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:04.854949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 590/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:55:04 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:55:07.038930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c011f6-0524-4357-a1e2-43784a74e996 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:07.039410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c011f6-0524-4357-a1e2-43784a74e996 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:07.039503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c011f6-0524-4357-a1e2-43784a74e996 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:07.040820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 588/1178] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:55:07.045947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:07.046378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:07.046481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:07.064384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:55:07.065555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:55:07.100568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:07.133862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 591/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:55:07.400776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c011f6-0524-4357-a1e2-43784a74e996 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:07.499812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c011f6-0524-4357-a1e2-43784a74e996 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:07.533432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:07.534044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:07.534323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:07.534592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:07.546041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:55:07.550775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:55:07.551902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:55:07.552779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 589/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:55:07.558000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:07.671682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc691bd-6642-421b-90c7-e9446ab986a8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:07.704382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:07.704984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:07.705266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:07.705538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:07.706193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:55:07.706497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:07.708800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:07.716577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 592/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:07.722547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:07.770953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:07.820711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c78a7-3a60-4b05-bfd3-ef5b19428a4a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:07.853469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:07.854086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:07.854370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:07.854676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] PATH_INFO: `/v3/users/b67b90d33c614d6980003fb60c1791e4` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:07.867935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b67b90d33c614d6980003fb60c1791e4)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:07.869378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:07.870991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 590/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:55:07 2022] GET /identity/v3/users/b67b90d33c614d6980003fb60c1791e4 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:07.876708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:07.911527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:07.976634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ceb5e6-d4a2-4b48-925a-b11311855f30 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:08.009577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:08.010176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:08.010454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:08.010750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:08.077545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:08.078999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:08.109918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:08.174351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 593/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:55:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:55:08.180915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:08.279938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9c49-971f-4c4f-b5c6-d46e0239d5d2 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:08.287592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:08.314147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:08.314799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:08.315084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:08.315362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] PATH_INFO: `/v3/projects/ba333035263e4d3580cd7541e94347d0` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:08.316467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] RBAC: Authorizing `identity:get_project(project_id=ba333035263e4d3580cd7541e94347d0)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:08.317894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37bf8-b9fb-4efe-8278-e968da62a06b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:08.319526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 591/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:55:08 2022] GET /identity/v3/projects/ba333035263e4d3580cd7541e94347d0 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:08.325677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:08.422530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd7a6c-366f-492e-a89c-2cb52783a7ee None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:08.455476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:08.456068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:08.456347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:08.456619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:08.457358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=ba333035263e4d3580cd7541e94347d0, user.id=b67b90d33c614d6980003fb60c1791e4) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:55:08.457808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:08.459261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1857fd-cb05-4b7f-860a-e12407883292 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:08.460999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:08.465482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 594/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:55:08 2022] GET /identity/v3/role_assignments?user.id=b67b90d33c614d6980003fb60c1791e4&scope.project.id=ba333035263e4d3580cd7541e94347d0&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:10.584187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e2e4-093c-4c2b-8f65-0e15fe5866a8 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:10.584754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e2e4-093c-4c2b-8f65-0e15fe5866a8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:10.584754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e2e4-093c-4c2b-8f65-0e15fe5866a8 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:10.586071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 592/1186] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:55:10.591339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:10.591733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:10.591888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:10.610218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:55:10.611410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:55:10.677034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 595/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:55:10.948967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e2e4-093c-4c2b-8f65-0e15fe5866a8 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:11.048851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e2e4-093c-4c2b-8f65-0e15fe5866a8 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:11.082480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:11.083129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:11.083414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:11.083688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:11.093466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:55:11.098424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:55:11.099574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:55:11.100787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 593/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:55:11.105642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:11.202687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f759-31a6-4760-8375-f430e7a912ce None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:11.228314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:11.236041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:11.236640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:11.236921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:11.237200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:11.237853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:55:11.238226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:11.240271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:11.248192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 596/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:11.253990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:11.288039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:11.351226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9edf33-4ee3-44aa-a7f2-19b10f47cab4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:11.383844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:11.384461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:11.384742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:11.385015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] PATH_INFO: `/v3/users/b67b90d33c614d6980003fb60c1791e4` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:11.386109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] RBAC: Authorizing `identity:get_user(user_id=b67b90d33c614d6980003fb60c1791e4)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:11.387583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:11.389134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 594/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:55:11 2022] GET /identity/v3/users/b67b90d33c614d6980003fb60c1791e4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:11.395169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:11.492078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825b1a6-c6db-4365-9d2c-03942bf7d67f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:11.523915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:11.524529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:11.524810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:11.525086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] PATH_INFO: `/v3/projects/ba333035263e4d3580cd7541e94347d0` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:11.526185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] RBAC: Authorizing `identity:get_project(project_id=ba333035263e4d3580cd7541e94347d0)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:11.527626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c5e1-9114-48c2-b87b-0471cab2d765 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:11.529222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 597/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:55:11 2022] GET /identity/v3/projects/ba333035263e4d3580cd7541e94347d0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:11.535819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:11.631654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131778e0-faa8-4aa6-9b06-9c88c51a4a9a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:11.633150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:11.668773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:11.669419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:11.669698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:11.669969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] PATH_INFO: `/v3/projects/ba333035263e4d3580cd7541e94347d0/users/b67b90d33c614d6980003fb60c1791e4/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:11.671833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba333035263e4d3580cd7541e94347d0, user_id=b67b90d33c614d6980003fb60c1791e4, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:11.673251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a45567-aa9a-41f0-8253-d931e19cea15 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:11.692777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 595/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:55:11 2022] PUT /identity/v3/projects/ba333035263e4d3580cd7541e94347d0/users/b67b90d33c614d6980003fb60c1791e4/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 16:55:13.806100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcccb-1c89-4714-bb14-bbd6174424b3 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:13.806635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcccb-1c89-4714-bb14-bbd6174424b3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:13.806635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbcccb-1c89-4714-bb14-bbd6174424b3 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:13.808005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 598/1193] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:55:13.813433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:13.813865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:13.813997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:13.832927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:55:13.834109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:55:13.899896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 596/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:55:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:55:14.170019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbcccb-1c89-4714-bb14-bbd6174424b3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:14.228689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:14.271963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbcccb-1c89-4714-bb14-bbd6174424b3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:14.305119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:14.305737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:14.306017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:14.306288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:14.316445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:55:14.321139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:55:14.322272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:55:14.323619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 599/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:55:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:55:14.328225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:14.416001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:14.426225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981272a7-1d77-4a5a-82ee-4842f5a0aaa2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:14.458438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:14.459055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:14.459338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:14.459609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:14.460273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:55:14.460569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:14.461931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:14.469602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 597/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:55:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:14.476248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:14.572006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd256e4-d07b-4294-a206-e070b1b8f979 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:14.588449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:14.605186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:14.605805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:14.606087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:14.606366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] PATH_INFO: `/v3/users/b67b90d33c614d6980003fb60c1791e4` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:14.607494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] RBAC: Authorizing `identity:get_user(user_id=b67b90d33c614d6980003fb60c1791e4)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:14.608909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:14.610455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 600/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 22 16:55:14 2022] GET /identity/v3/users/b67b90d33c614d6980003fb60c1791e4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:14.616731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:14.714511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453601e0-bba4-408e-bd67-8e7c723c56cd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:14.747646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:14.748246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:14.748530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:14.748806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:14.772150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:14.814958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:14.816961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:14.912635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 598/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:55:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:55:14.918694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:15.017254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694e39-de21-4664-81ff-f541a925b55c None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:15.049630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:15.050255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:15.051173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:15.051497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] PATH_INFO: `/v3/projects/ba333035263e4d3580cd7541e94347d0` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:15.052645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] RBAC: Authorizing `identity:get_project(project_id=ba333035263e4d3580cd7541e94347d0)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:15.054058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a7e7b-9f6e-4379-a7c0-90554724adcd None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:15.055671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 601/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 22 16:55:14 2022] GET /identity/v3/projects/ba333035263e4d3580cd7541e94347d0 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:15.063997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:55:15.117220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:15.160451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc754e7-0ca1-4daa-a1f4-5bebdd364336 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:55:15.193300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:55:15.193896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:55:15.194180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:55:15.194455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:55:15.195206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=ba333035263e4d3580cd7541e94347d0, user.id=b67b90d33c614d6980003fb60c1791e4) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:55:15.195523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:55:15.196940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233148a2-a622-423e-a025-e28bd6e5f705 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:55:15.202470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 599/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:55:15 2022] GET /identity/v3/role_assignments?user.id=b67b90d33c614d6980003fb60c1791e4&scope.project.id=ba333035263e4d3580cd7541e94347d0&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:55:25.045643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=73 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:55:25.199970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=41 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:10.905076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375fa8-e6d6-496b-9a79-f213ea2bf26c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:10.906335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375fa8-e6d6-496b-9a79-f213ea2bf26c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:10.906335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375fa8-e6d6-496b-9a79-f213ea2bf26c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:10.907924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 602/1201] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:10.913599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:10.914081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:10.914186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:10.933580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:10.934882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:11.021630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 600/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:11.294164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c375fa8-e6d6-496b-9a79-f213ea2bf26c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:11.427490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c375fa8-e6d6-496b-9a79-f213ea2bf26c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:11.471888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:11.472620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:11.472958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:11.473188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:11.485989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:11.487530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:11.505302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:11.512332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:11.513598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:11.513598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:11.513598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:11.513598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 603/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:11.513926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:11.650147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a6b5f-35b1-4dce-bcfb-5975c6aee9e6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:11.696465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:11.704548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:11.705358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:11.705641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:11.705913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:11.706561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:11.706893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:11.708376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c708740-7703-4101-ac8d-55741a37124b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:11.723148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 601/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:11.730690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:11.795881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:11.858757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674bf04-bb05-414f-9447-ce2d6a3955d7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:11.904901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:11.905546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:11.906090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:11.906168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:11.906810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:11.908408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c681d-8bd2-4bb9-b104-0215d8d157a1 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:11.935996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 604/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 22 16:56:11 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:56:14.453532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ad89-f65f-4fd1-b582-dfffb4144f21 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:14.454181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ad89-f65f-4fd1-b582-dfffb4144f21 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:14.454377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ad89-f65f-4fd1-b582-dfffb4144f21 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:14.456044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 602/1206] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:14.461314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015805e-c111-459b-ab5f-5224313af01b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:14.461748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015805e-c111-459b-ab5f-5224313af01b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:14.461866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015805e-c111-459b-ab5f-5224313af01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:14.481320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3015805e-c111-459b-ab5f-5224313af01b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:14.482569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3015805e-c111-459b-ab5f-5224313af01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:14.563999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 605/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:14.836238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ad89-f65f-4fd1-b582-dfffb4144f21 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:14.967903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ad89-f65f-4fd1-b582-dfffb4144f21 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.013920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.015165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.015622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.016044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.028217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:15.033980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:15.035211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:15.036093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 603/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:15.041694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015805e-c111-459b-ab5f-5224313af01b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:15.087333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:15.159676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015805e-c111-459b-ab5f-5224313af01b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.200657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.201275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.201599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.202464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.203372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:15.203813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:15.205794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:15.214392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 606/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:15.221061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:15.281586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:15.342180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808348-cdf4-4845-b7ba-e823a72787af None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.383665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.384315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.384596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.384878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.399387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:15.401112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:15.420193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:15.422380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:15.423540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:15.423540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:15.423540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:15.427592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 604/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:56:15.428578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:15.555273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fc69c-84be-48aa-b6fa-c7bf3fab7b65 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.557238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:15.597193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.597733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.598021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.598293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.598956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:15.599262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:15.600780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:15.620337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 607/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:15.621468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:15.742777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bd6ef-f66b-4622-a4fd-c0e31fc21fb7 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.744465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:15.779760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.781219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.781537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.781810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.790879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:15.792318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:15.804047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:15.805056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:15.806076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:15.809961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 605/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:15.810911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:15.932266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b132e4d-f0f7-4a88-b0c5-6d0eb6b692e4 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:15.975903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:15.976517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:15.976799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:15.978694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:15.978694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:15.978694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:15.980091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:16.001736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 608/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:16.007603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:16.147130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740de10-6ee7-47f3-abf1-28b747f99553 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:16.200406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:16.200939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:16.201267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:16.201543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:16.236001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:16.284441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:16.286053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:16.398803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 606/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:56:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:56:16.406955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:16.429562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:16.528614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78b100-55bb-4e5b-bd86-a6ed3ef367ef None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:16.570483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:16.571173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:16.571401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:16.571678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:16.584970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:16.586432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:16.603087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:16.604247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:16.605308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:16.605308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:16.605308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:16.605308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 609/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:56:16.610719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:16.684883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:16.735123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9ff1c-bb00-4a18-87f7-fb143052ee92 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:16.783239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:16.783818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:16.784098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:16.784370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:16.785231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:16.785596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:16.786981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:16.806034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 607/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:16.807255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:16.889877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:16.934015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802767de-f29d-44a2-b609-2e5082e3fbb7 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:16.988159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:16.988812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:16.989097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:16.989453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:16.998346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:17.000357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:17.012467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:17.013648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:17.016010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 610/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:17.020643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:17.136979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab28d3-6eee-433b-a46c-bbaa1dd3be36 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:17.172038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:17.185293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:17.185981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:17.186854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:17.187136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:17.187923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:17.188152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:17.189591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca3a6d-faf4-46a3-a76a-540f547ffd60 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:17.204833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 608/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:17.211589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:17.350428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41963bfd-bf2c-4977-a231-07d9c7312fdb None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:17.383171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:17.391110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:17.391724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:17.392068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:17.392403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:17.393232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=30ceabc5940d40cf8a339f17a375716c) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:17.393603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:17.395163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25818cea-1de1-452e-b4f9-6ff4c7872615 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:17.400535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 611/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:56:17 2022] GET /identity/v3/role_assignments?user.id=30ceabc5940d40cf8a339f17a375716c&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:19.628721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85cc1-6f3e-46ed-9f58-751f22a80d78 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:19.629289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85cc1-6f3e-46ed-9f58-751f22a80d78 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:19.629289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc85cc1-6f3e-46ed-9f58-751f22a80d78 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:19.630976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 609/1220] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:19.636398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:19.636970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:19.636970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:19.657436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:19.658635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:19.744268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 612/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:20.030299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85cc1-6f3e-46ed-9f58-751f22a80d78 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:20.152492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc85cc1-6f3e-46ed-9f58-751f22a80d78 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:20.207270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:20.207910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:20.208188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:20.208460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:20.224010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:20.230331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:20.231693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:20.233284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 610/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:20.241347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:20.384477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675704d7-eddc-4661-932a-7f5bf30da9a4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:20.422870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:20.434698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:20.435366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:20.435799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:20.436200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:20.436960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] RBAC: Adding query filter params (name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:20.437269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:20.439393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:20.453305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 613/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:56:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:56:20.459484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:20.516310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:20.585215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a7bb-5ed9-4661-b856-3a2275fabd0d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:20.625425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:20.626523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:20.627068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:20.627526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:20.646084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:20.647691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:20.664232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:20.665708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:20.667082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:20.667082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:20.667082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:20.667082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 611/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:20.678190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:20.812357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323ccd7-b090-4ae3-97b2-562aaec5f514 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:20.854811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:20.855477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:20.855755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:20.856031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:20.856691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:20.856988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:20.859203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:20.881644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 614/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:20.883117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.010578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:21.018754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acac3-2ea6-4993-9522-c639c2b05222 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:21.053899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:21.055133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:21.055133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:21.055133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:21.063621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:21.064992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:21.082253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:21.083698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:21.085003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 612/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:21.090536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.145562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:21.210361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81290d23-b464-43a3-986a-2f732007cc5e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:21.246258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:21.246891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:21.247164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:21.247430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:21.248720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:21.249275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:21.250928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:21.270518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 615/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:21.277605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.381603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b725a-a9c9-4765-8d20-ed27cc14f56d None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:21.422968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:21.423723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:21.424031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:21.424300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:21.437079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:21.438700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:21.457795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:21.459026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:21.459997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:21.459997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:21.459997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:21.459997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 613/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:21.467939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.584765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1af19-0807-4a72-8bf2-ae0a6eff51f8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:21.587483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:21.627603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:21.628320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:21.628700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:21.629185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:21.629888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:21.630235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:21.631917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:21.645851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 616/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:21.652007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.663106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:21.805019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a260-aae1-4d91-a9fb-8efac2ec6239 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:21.839639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:21.840266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:21.840550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:21.840819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:21.848782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:21.850264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:21.863132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:21.864348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:21.865502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 614/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:56:21.871152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:21.985710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafccdc-0190-4b89-b32b-6a36eca42098 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:22.022864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:22.023559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:22.023859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:22.024182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:22.024958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:22.025333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:22.027167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78413e8-c414-4dac-9087-cd06514176b4 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:22.040828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 617/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:22.048058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:22.121560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:22.163904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ba4bf-4c21-43bd-a1c2-851121300304 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:22.204818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:22.205561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:22.205848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:22.206161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/30ceabc5940d40cf8a339f17a375716c/roles/d460e6e9760a4e83a84c4e9215d4b35d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:22.223063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=30ceabc5940d40cf8a339f17a375716c, role_id=d460e6e9760a4e83a84c4e9215d4b35d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:22.224843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a660e25-e631-4029-b183-da884b9c83e5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:22.238780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 615/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:56:22 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/30ceabc5940d40cf8a339f17a375716c/roles/d460e6e9760a4e83a84c4e9215d4b35d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:56:24.671894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fb6b-3712-4ede-9058-0df23110ec97 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:24.672481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fb6b-3712-4ede-9058-0df23110ec97 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:24.672640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fb6b-3712-4ede-9058-0df23110ec97 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:24.674705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 618/1233] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:24.680124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:24.680608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:24.680699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:24.701400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:24.702804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:24.778234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 616/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:25.065299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6fb6b-3712-4ede-9058-0df23110ec97 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:25.094648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:25.186415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6fb6b-3712-4ede-9058-0df23110ec97 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:25.226404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:25.227137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:25.227417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:25.227689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:25.239253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:25.244288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:25.245257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:25.246375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 619/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 16:56:25.253735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:25.302745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:25.362674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d7bc5-360a-4000-9c5d-645851d5bcda None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:25.403488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:25.404420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:25.404820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:25.405082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:25.405765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:25.406109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:25.407506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:25.415760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 617/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:25.422182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:25.514106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:25.532697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df151a-710e-4963-bd14-4c4e90f99a3f None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:25.574319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:25.575079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:25.575364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:25.575760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:25.589644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:25.591150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:25.608815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:25.610225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:25.611195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:25.611195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:25.611195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:25.611195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 620/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:25.616308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:25.738703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2786d-c4b8-4d77-a722-5f04023489b6 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:25.749406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:25.775467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:25.776471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:25.776937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:25.777284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:25.778194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:25.778590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:25.780925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:25.796538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 618/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:25.802364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:25.915000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e11645-acb5-40e9-96ff-e6ead3f63060 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:25.954851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:25.955489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:25.955784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:25.956093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:25.959415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:25.966301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:25.968117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:25.979829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:25.981029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:25.982645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:25.987968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 621/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:25.988522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:26.105091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4fd48-11ef-40ad-81a1-89880a28ff2c None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:26.142148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:26.142828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:26.143107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:26.143389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:26.144156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:26.144460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:26.145882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:26.165919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 619/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:56:26.172260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:26.287508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084590af-3609-49de-a887-b6a2ba57bb9d None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:26.327895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:26.328515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:26.328787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:26.329094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:26.392720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:26.399595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:26.401357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:26.518451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 622/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:56:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:56:26.524338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:26.553299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:26.635531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9170aa-f9fc-4827-a2e6-c9746cdae2c0 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:26.678088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:26.678720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:26.679077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:26.679491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:26.691131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:26.692914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:26.711627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:26.712814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:26.713907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:26.713907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:26.713907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:26.713907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 620/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:26.719709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:26.820145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:26.826965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546dff4-2477-4c7f-928c-cf18f38e72b8 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:26.864677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:26.865544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:26.865945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:26.866259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:26.867197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:26.867656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:26.869656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:26.884884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 623/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:26.891697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:26.984277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:27.007913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a5e3b-595c-48f6-ba05-58daa5254b90 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:27.044175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:27.044815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:27.045096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:27.045392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:27.052600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:27.055931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:27.069033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:27.074817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:27.076648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 621/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:27.077453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:27.199544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee511-12ec-4648-b859-9e6b561f7bec None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:27.239593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:27.240806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:27.241083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:27.241382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:27.242098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:27.242395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:27.244335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8770fb-5d0e-43c9-84d3-18de65931d5e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:27.263877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 624/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:27.265382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:27.374747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bae63-892f-4e2e-bd3d-5ce394fab128 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:27.415869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:27.416620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:27.416914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:27.417189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:27.418046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] RBAC: Adding query filter params (role.id=d460e6e9760a4e83a84c4e9215d4b35d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=30ceabc5940d40cf8a339f17a375716c) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:27.418355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:27.420095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b07ec-2f27-42b9-a432-728a33af9e86 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:27.426565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 622/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:56:27 2022] GET /identity/v3/role_assignments?user.id=30ceabc5940d40cf8a339f17a375716c&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=d460e6e9760a4e83a84c4e9215d4b35d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:29.717031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83fd6-84fc-41b0-8da9-c646ced2542a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:29.717639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83fd6-84fc-41b0-8da9-c646ced2542a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:29.717639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a83fd6-84fc-41b0-8da9-c646ced2542a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:29.719224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 625/1247] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:29.724500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:29.724935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:29.725066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:29.733282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:29.747308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:29.749548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:29.826915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 623/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:30.132557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a83fd6-84fc-41b0-8da9-c646ced2542a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:30.151937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:30.243774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a83fd6-84fc-41b0-8da9-c646ced2542a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:30.281547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:30.282213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:30.282495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:30.282827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:30.297225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:30.302286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:30.303501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:30.304630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 626/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:30.310345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:30.423130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7117cb-339b-48d6-a01f-e6e84f7e5001 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:30.455264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:30.460876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:30.461555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:30.461841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:30.462168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:30.462906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:30.463310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:30.464825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:30.473876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 624/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:56:30.479873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:30.563576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:30.589759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bced3-573a-4019-a916-6a1c2f9ac828 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:30.629022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:30.629718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:30.629994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:30.630263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:30.641251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:30.642813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:30.658669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:30.659880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:30.660864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:30.660864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:30.660864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:30.664653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 627/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:30.665723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:30.779748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ca83e-7ab0-4a35-8176-33d2f2968a8a None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:30.817653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:30.818587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:30.818907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:30.819188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:30.819851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:30.820163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:30.821591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:30.837461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 625/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:30.843287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:30.959108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e30e-caad-4944-846e-bac0f273f465 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:30.988546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:30.996981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:30.998166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:30.998449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:30.998775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.007343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.008834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:31.021500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:31.022614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:31.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 628/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:31.029031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:31.088625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:31.135497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2052f9-d84b-42bf-a796-a935fe8648a4 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:31.173083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:31.173720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:31.174004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:31.174281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.175069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:31.175384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.176844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:31.201550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 626/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:31.202843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:31.307089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a3288-f48e-4e04-8ebb-d9de8b2b0fdc None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:31.341020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:31.341750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:31.342041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:31.342317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.400355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:31.414383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.415918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:31.516141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 629/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:56:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:56:31.522005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:31.619628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4168d-8619-4dce-a347-0477b48b0693 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:31.632731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:31.654222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:31.654861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:31.655140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:31.655411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.665454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.667262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:31.687469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:31.688650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:31.689713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:31.689713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:31.689713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:31.689713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 627/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:31.695026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:31.782222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:31.794116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29602536-77d9-4bc1-ad1e-437362d1717e None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:31.827721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:31.828319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:31.828599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:31.828870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.829503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:31.829805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.831194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:31.842293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 630/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:31.848062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:31.950146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d7fa0-66e3-4665-b166-4ba69aaff7a7 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:31.985487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:31.986115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:31.986393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:31.986681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:31.993291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:31.994777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:32.006165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:32.007280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:32.008255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 628/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:32.013062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:32.110152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267d02b-9129-43ba-8400-4a3b2388a93a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:32.142198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:32.142820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:32.143097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:32.143368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:32.144042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:32.144346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:32.145753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189a77a-f287-4b85-a64d-f1590506d787 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:32.157647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 631/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:32.163622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:32.189360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:32.262351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b60e-e98b-4698-a1da-56f3e5e662cd None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:32.297791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:32.298374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:32.298685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:32.298961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:32.299684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=30ceabc5940d40cf8a339f17a375716c) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:32.299994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:32.301411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60066e27-06ec-453e-933d-00b4af81e6a5 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:32.306604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 629/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:56:32 2022] GET /identity/v3/role_assignments?user.id=30ceabc5940d40cf8a339f17a375716c&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:34.412345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517067-a47b-4ec7-a7af-7e60ef05dfaa None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:34.412867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517067-a47b-4ec7-a7af-7e60ef05dfaa None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:34.412867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef517067-a47b-4ec7-a7af-7e60ef05dfaa None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:34.414220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 632/1261] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:34.419685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:34.420111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:34.420251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:34.439548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:34.440737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:34.505646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 630/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 16:56:34.785392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef517067-a47b-4ec7-a7af-7e60ef05dfaa None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:34.796800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:34.885331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef517067-a47b-4ec7-a7af-7e60ef05dfaa None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:34.920756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:34.921387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:34.921675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:34.921951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:34.932407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:34.937475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:34.938607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:34.939854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 633/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:34.944513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:34.962592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:35.043800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f373-7eb9-48a5-b6d5-b59260810614 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.076792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.077395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.077679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.077953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.078619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:35.078956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.080316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.088077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 631/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:56:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:35.094483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:35.161169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:35.194081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2175a-fcf8-4e7e-8533-4b28315f75a5 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.227454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.228068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.228350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.228626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.239048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.240486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:35.254409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:35.255571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:35.256702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:35.256702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:35.256702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:35.256702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 634/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:35.261344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:35.341760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:35.360665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c486e-9965-4c16-a6d3-2535b1b1955b None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.393996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.394585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.394888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.395158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.395790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:35.396094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.397442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.409067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 632/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:35.414630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:35.511912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824abc3-6d18-4161-aca1-6e502a90a268 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.531926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:35.546006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.546627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.546941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.547217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.554396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.555867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:35.567482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:35.568605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:35.569868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 635/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:35.574284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:35.673219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec86393-c144-4514-ace4-16977b776125 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.711575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.712171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.712449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.712718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.713437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:35.713738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.715190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.724289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:35.733673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 633/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:35.739455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:35.836730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c4cf-1fac-4a37-8307-26e0252cc567 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:35.869371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:35.869986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:35.870270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:35.870547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:35.880956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:35.882398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:35.896719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:35.897867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:35.898868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:35.898868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:35.898868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:35.898868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 636/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:35.903782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:36.000024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165199-78ca-47f1-a044-073f52e2a0be None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:36.033427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:36.034019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:36.034296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:36.034561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:36.035221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:36.035521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:36.036902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:36.047889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 634/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:36.053515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:36.085199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:36.152203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e07d0-28df-4b4b-b8dc-92149690ccf6 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:36.183825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:36.184988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:36.185265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:36.185537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:36.191984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:36.193422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:36.205000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:36.206046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:36.207367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 637/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:36.211826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:36.268792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:36.311353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae58b-080b-4440-bae6-6ef32e2c61ad None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:36.344017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:36.344607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:36.344888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:36.345161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:36.345843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:36.346145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:36.347592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e353a81-302a-4a43-946f-259947ced150 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:36.359647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 635/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:36.365512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:36.456035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:36.468695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339713aa-bf32-42c1-8eda-1940f147c2b0 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:36.501210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:36.501858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:36.502145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:36.502419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] PATH_INFO: `/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/30ceabc5940d40cf8a339f17a375716c/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:36.504300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] RBAC: Authorizing `identity:create_grant(project_id=37260af8ddaf447e929f5facaeaf0357, user_id=30ceabc5940d40cf8a339f17a375716c, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:36.505721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439b009-9326-4b07-ad4a-0d328e4e8786 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:36.518471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 638/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 22 16:56:36 2022] PUT /identity/v3/projects/37260af8ddaf447e929f5facaeaf0357/users/30ceabc5940d40cf8a339f17a375716c/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 16:56:38.643317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760573-43ca-459c-ba8d-210d360eea2d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:38.643917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760573-43ca-459c-ba8d-210d360eea2d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:38.643917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c760573-43ca-459c-ba8d-210d360eea2d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:38.645183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 636/1274] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:38.650769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:38.651139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:38.651327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:38.670608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:38.671826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:38.750979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 639/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:39.018813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760573-43ca-459c-ba8d-210d360eea2d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.117696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c760573-43ca-459c-ba8d-210d360eea2d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.134883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:39.152270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.153114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.153402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.153676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.163416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 16:56:39.168177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:39.169900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:39.171404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 637/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:39.175342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.254698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:39.273411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f2ed-8ab4-43c5-8bd8-cd3c752ac69c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.306342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.306968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.307252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.307526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.308182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:39.308485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:39.310357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:39.318144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 640/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 16:56:39.323952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.425884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92564de-db13-41dd-b41f-449925845eb1 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.458807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.459421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.459702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.459977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.469650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:39.471117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:39.486436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:39.487451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:39.488705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:39.488705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:39.488705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:39.488705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 638/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:39.493261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.591104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cb72-73e1-406c-8269-960c1bf9096a None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.624038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.624637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.624918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.625194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.625827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:39.626217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:39.627606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:39.639262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 641/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:39.644808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.676940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:39.746373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb6732-4cce-45e6-8a36-ca07f93db1ea None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.779994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.780623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.780908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.781181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.788500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:39.789934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 16:56:39.801647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:39.802812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:39.804039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 639/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:39.808643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:39.812387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:39.906112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15444-a532-4f7b-9894-1e8f23d559af None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:39.938340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:39.938971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:39.939251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:39.939518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:39.940222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:39.940523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:39.941964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:39.958129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 642/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:39.964030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:40.053531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:40.063513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2205f-b44e-4b2a-9381-9d6070c5961f None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:40.096048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:40.096647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:40.096931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:40.097201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:40.162307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:40.163716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:40.248642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:40.259011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 640/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 22 16:56:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 16:56:40.265527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:40.326777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:40.364859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b422da-c15a-4624-94d5-00a4089b3c61 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:40.398149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:40.398799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:40.399083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:40.399357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:40.409381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:40.410862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 16:56:40.425541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:40.430888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 16:56:40.432097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 16:56:40.432097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 16:56:40.432097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:40.432097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 643/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 16:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:40.432472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:40.536779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35251e31-f32b-4ef7-9a85-9f4768f43039 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:40.569505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:40.570103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:40.570387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:40.570696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:40.571325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:40.571633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:40.572998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:40.584182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 641/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 22 16:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:40.589834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:40.688995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf2991-41e0-4e49-a144-14a91cdf2860 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:40.702283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:40.722643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:40.723301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:40.723584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:40.723860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:40.730308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:40.732398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 16:56:40.743351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:40.744418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: ERROR keystone.server.flask.application Sep 22 16:56:40.745563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 644/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 22 16:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:40.750552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:40.800059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:40.849145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638446e-7030-4901-bcb5-4b484be27335 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:40.882983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:40.883586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:40.883867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:40.884138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:40.884819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:40.885125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:40.886549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad76b8-695d-480f-8c36-f9f262b296b8 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:40.899043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 642/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 22 16:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:40.906344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:41.006062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacce52-a5df-4bae-ab43-d879dca98322 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:41.039890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:41.040503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:41.040774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:41.041050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:41.041765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] RBAC: Adding query filter params (role.id=039ce10567a8460a9bd21a4b11653a8d, scope.project.id=37260af8ddaf447e929f5facaeaf0357, user.id=30ceabc5940d40cf8a339f17a375716c) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:41.042076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:41.043578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efbfca-b4eb-4fee-b9f4-0f12fbaf1d4c None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:41.049235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 645/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 22 16:56:40 2022] GET /identity/v3/role_assignments?user.id=30ceabc5940d40cf8a339f17a375716c&scope.project.id=37260af8ddaf447e929f5facaeaf0357&role.id=039ce10567a8460a9bd21a4b11653a8d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:43.229804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123031-761a-4379-bd2e-04d9c7f143d1 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:43.230354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123031-761a-4379-bd2e-04d9c7f143d1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:43.230354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d123031-761a-4379-bd2e-04d9c7f143d1 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:43.231744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 643/1288] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:43.237095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:43.237488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:43.237580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:43.255424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:43.256607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:43.286211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:43.322352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 646/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:43.589599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d123031-761a-4379-bd2e-04d9c7f143d1 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:43.690258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d123031-761a-4379-bd2e-04d9c7f143d1 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:43.701874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:43.726807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:43.727538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:43.727886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:43.728216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] PATH_INFO: `/v3/services/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:43.728800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:43.730182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:43.739156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:43.740524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:43.741429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 644/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:56:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:43.748336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:43.844825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4df3-9af4-451e-964d-2bcbdf957cf2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:43.877580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:43.878178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:43.878463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:43.878762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:43.879387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] RBAC: Adding query filter params (name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:43.879692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:43.881049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce5291-eb31-4c1a-9696-3f96520c92ce None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:43.885681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 647/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 22 16:56:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:43.892160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:43.991593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58a92-e66a-4ea8-a6f1-364a9938cada None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:44.024691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:44.025536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:44.025811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:44.026081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] PATH_INFO: `/v3/services` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:44.026725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:44.027030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:44.028727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f93e2c-1686-46ae-a0a2-e14cb7741f02 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:44.032993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 645/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 22 16:56:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:46.160023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74a7e-0534-4f1b-9368-22629b4beb12 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:46.160585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74a7e-0534-4f1b-9368-22629b4beb12 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:46.160585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb74a7e-0534-4f1b-9368-22629b4beb12 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:46.161941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 648/1293] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:46.167245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509f85-34d6-4055-86d3-c872895ec911 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:46.168189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509f85-34d6-4055-86d3-c872895ec911 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:46.168375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f509f85-34d6-4055-86d3-c872895ec911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:46.186615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8f509f85-34d6-4055-86d3-c872895ec911 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:46.187819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8f509f85-34d6-4055-86d3-c872895ec911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:46.216033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:46.252574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 646/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:46.517659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb74a7e-0534-4f1b-9368-22629b4beb12 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:46.549743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:46.618585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb74a7e-0534-4f1b-9368-22629b4beb12 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:46.651268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:46.652377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:46.652676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:46.652941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:46.653577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:46.654958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f1360-2aaa-4d71-97d0-af140c29dd75 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:46.670327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 649/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 22 16:56:46 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:56:48.855712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44dd93-fbba-4ca8-b6c2-d8d5d491d5b3 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:48.856333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44dd93-fbba-4ca8-b6c2-d8d5d491d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:48.856333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44dd93-fbba-4ca8-b6c2-d8d5d491d5b3 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:48.857598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 647/1296] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:48.862648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:48.863116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:48.863225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:48.881531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:48.882744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:48.953660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 650/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:49.222965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44dd93-fbba-4ca8-b6c2-d8d5d491d5b3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:49.321536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44dd93-fbba-4ca8-b6c2-d8d5d491d5b3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:49.355241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:49.355852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:49.356133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:49.356406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:49.356983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:49.358360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:49.367068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:49.368336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:49.369273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 648/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:56:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:49.374133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:49.392481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:49.472693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef8cc-daf1-42e6-8cd5-818599923ab4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:49.505082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:49.505628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:49.505912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:49.506190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:49.506849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:49.507158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:49.508526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:49.514040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 651/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 22 16:56:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:49.519936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:49.551241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:49.618165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f8f68-df7d-41c7-9605-acd4ede30b55 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:49.651372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:49.652189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:49.652525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:49.652805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:49.653493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] RBAC: Adding query filter params (interface=public, service_id=5f7c46ca2e6d4331a6912d2646547783, region_id=RegionOne) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:49.653802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:49.655188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754bf82-3ec0-4238-95c7-ce22b4222965 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:49.659952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 649/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 22 16:56:49 2022] GET /identity/v3/endpoints?service_id=5f7c46ca2e6d4331a6912d2646547783&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:49.665557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:49.751286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:49.769628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383459-e7da-456c-9c6d-a51537932553 None admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:49.802576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:49.803205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:49.803483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:49.803753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:49.804349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:49.805727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc471f63-0714-494d-a41b-d9978e1cfa22 None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:49.813126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 652/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 22 16:56:49 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 16:56:51.940987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550698e7-ea7d-4fb2-b884-e71389cfaa71 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:51.941558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550698e7-ea7d-4fb2-b884-e71389cfaa71 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:51.941558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550698e7-ea7d-4fb2-b884-e71389cfaa71 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:51.942898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 650/1302] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:56:51.948085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:51.949170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:51.949282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:51.967103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:56:51.968275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:56:52.034332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 653/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:56:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 16:56:52.304123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550698e7-ea7d-4fb2-b884-e71389cfaa71 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:52.398041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:52.406502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550698e7-ea7d-4fb2-b884-e71389cfaa71 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:52.438969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:52.439582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:52.439859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:52.440128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:52.440696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:52.442052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 16:56:52.451455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 16:56:52.452624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application with Lock( Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self._enter() Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application return self.creator() Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application created_value = creator( Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: ERROR keystone.server.flask.application Sep 22 16:56:52.453502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 651/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 22 16:56:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 16:56:52.458489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:52.533584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:56:52.555977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13df07-e780-4d21-a918-c5a1fd297b7b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:52.591478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:52.592096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:52.592381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:52.592659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] PATH_INFO: `/v3/services` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:52.593284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 16:56:52.593593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:52.594981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b67781-a5a2-4fcd-b0f5-d6da10b3748e None admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:52.600036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 654/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 22 16:56:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 16:56:52.606461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:56:52.708220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fae719-275b-4bb8-93de-924b5b75e880 None admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:56:52.744088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:56:52.744684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:56:52.744963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:56:52.745414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:56:52.746233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:56:52.747616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e75c9-1f05-4da4-ad88-fb1f0b5fe020 None admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:56:52.766247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 652/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 16:56:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 16:57:02.597042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=30 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:57:02.762175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:57:57.148141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bc12c-4a85-415e-a3b5-093b07f2f528 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:57:57.148814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bc12c-4a85-415e-a3b5-093b07f2f528 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:57:57.148814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bc12c-4a85-415e-a3b5-093b07f2f528 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:57:57.151065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 655/1307] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:57:57.155914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3767-732b-45e4-8877-6d155cb36271 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:57:57.156420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3767-732b-45e4-8877-6d155cb36271 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:57:57.156517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3767-732b-45e4-8877-6d155cb36271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:57:57.305187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-cc0b3767-732b-45e4-8877-6d155cb36271 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:57:57.308571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cc0b3767-732b-45e4-8877-6d155cb36271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:57:57.466680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 653/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:57:57.749234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:57:57.749904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:57:57.750402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:57:57.752220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 656/1309] 10.222.0.50 () {54 vars in 964 bytes} [Thu Sep 22 16:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:57:57.758704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c23d-d2bb-4645-b542-d044ae45560b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:57:57.759006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c23d-d2bb-4645-b542-d044ae45560b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:57:57.759284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c23d-d2bb-4645-b542-d044ae45560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:57:57.858523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bff7c23d-d2bb-4645-b542-d044ae45560b None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:57:57.860124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bff7c23d-d2bb-4645-b542-d044ae45560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:57:57.892458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:57:57.960199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 654/1310] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Sep 22 16:57:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:57:57.969950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:57:57.972215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:57:58.116951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dc6c1-ac78-41cd-b6e6-8b879870f2f6 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:57:58.205280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:57:58.206752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:57:58.207882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:57:58.208605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:57:58.210569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:57:58.276093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:57:58.349334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:57:58.351236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353bb68-1185-486f-95a4-f30e797e3ce2 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:57:58.376959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 657/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:00.890578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:00.891138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:00.891138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:00.892474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 655/1312] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:00.897975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28b04-8404-4bb8-a320-dcaeb66d4f8d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:00.898429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28b04-8404-4bb8-a320-dcaeb66d4f8d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:00.898537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28b04-8404-4bb8-a320-dcaeb66d4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:00.980566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-84e28b04-8404-4bb8-a320-dcaeb66d4f8d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:00.981697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-84e28b04-8404-4bb8-a320-dcaeb66d4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:01.081245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 658/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:01.373536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:01.375146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:01.486419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26758c9-e8e8-4490-8709-d4ce70bf5f54 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:01.559167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:01.561623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:01.562445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:01.562822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:01.563229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:01.565038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:01.676200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:01.678018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f33f6-8058-4b56-bb32-3bb82517916e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:01.697099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 656/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:04.158966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:04.160117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:04.160117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:04.161428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 659/1315] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:04.166533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94b84b-2ccb-4e01-b2e7-ad0ebac06644 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:04.166969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94b84b-2ccb-4e01-b2e7-ad0ebac06644 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:04.167106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94b84b-2ccb-4e01-b2e7-ad0ebac06644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:04.232838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4c94b84b-2ccb-4e01-b2e7-ad0ebac06644 None None] MFA Rules not processed for user `e632ab14fc6d4687bca9af60a4b88241`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:04.234095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4c94b84b-2ccb-4e01-b2e7-ad0ebac06644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:04.286865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:04.330718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 657/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:04.625979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:04.627544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:04.637818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:04.735360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6414b9b-e17f-4a60-a9f8-6d2e99df030e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:04.808504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:04.809106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:04.809383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:04.809652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:04.811245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:04.873268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:04.919528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:04.920965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d84507-bce9-4823-8dbe-b907ef34e52e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:04.939553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 660/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:07.648725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcbc6-f4a0-4166-9a60-26d4232f889d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:07.649296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcbc6-f4a0-4166-9a60-26d4232f889d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:07.649296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdcbc6-f4a0-4166-9a60-26d4232f889d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:07.650634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 658/1318] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:07.655870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66f02-6945-4673-9506-6865d45416fd None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:07.656269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66f02-6945-4673-9506-6865d45416fd None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:07.656413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66f02-6945-4673-9506-6865d45416fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:07.724109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c9a66f02-6945-4673-9506-6865d45416fd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:07.725298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c9a66f02-6945-4673-9506-6865d45416fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:07.821992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 661/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:08.132043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:08.132332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:08.132610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:08.133947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 659/1320] 10.222.0.50 () {54 vars in 964 bytes} [Thu Sep 22 16:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:08.139738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085227-7cc3-4a8d-997a-4c7f0d8e2247 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:08.140029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085227-7cc3-4a8d-997a-4c7f0d8e2247 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:08.140310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085227-7cc3-4a8d-997a-4c7f0d8e2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:08.162644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:08.216455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5d085227-7cc3-4a8d-997a-4c7f0d8e2247 None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:08.217656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5d085227-7cc3-4a8d-997a-4c7f0d8e2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:08.291851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 662/1321] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Sep 22 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:08.300685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:08.302198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:08.403920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98efbc-dc84-41ed-a780-5f09935249a2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:08.481238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:08.481835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:08.482114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:08.482386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:08.483977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:08.490885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:08.591221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:08.592575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1bf1e-a811-4445-8c15-14726c91aaa8 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:08.609867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 660/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 16:58:11.876135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:11.876545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:11.876634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:11.879644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 663/1323] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:11.885309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf64a-b271-4288-95c0-0934992152fc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:11.885309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf64a-b271-4288-95c0-0934992152fc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:11.885922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf64a-b271-4288-95c0-0934992152fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:11.959034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-326cf64a-b271-4288-95c0-0934992152fc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:11.960319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-326cf64a-b271-4288-95c0-0934992152fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:12.028853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:12.072709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 661/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:12.359654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:12.361176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:12.468220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b13b7-b3c0-4075-a7de-360466023079 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:12.482290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:12.545776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:12.546389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:12.546696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:12.546974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:12.548591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:12.663607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:12.665034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e11171-6b33-4a5a-a79b-265212e36c30 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:12.684829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 664/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:14.906520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:14.907097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:14.907097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:14.908548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 662/1326] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:14.914050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907407-0edc-450a-b43a-f33898b1b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:14.914526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907407-0edc-450a-b43a-f33898b1b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:14.914694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14907407-0edc-450a-b43a-f33898b1b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:14.972866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:14.993785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-14907407-0edc-450a-b43a-f33898b1b8b6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:14.995046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-14907407-0edc-450a-b43a-f33898b1b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:15.093359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 665/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:15.376376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:15.378514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:15.483684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b83277-9487-48c0-9db7-0b83e7d38900 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:15.559470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:15.560084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:15.560366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:15.560640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:15.562230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:15.581529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:15.678312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:15.679706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c0a2b-8543-4b28-84d2-f3a710259647 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:15.697868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 663/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:17.929833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:17.930370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:17.930370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:17.931769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 666/1329] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:17.937137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc36fe-6b10-4fe9-9e78-09fc50542c85 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:17.937542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc36fe-6b10-4fe9-9e78-09fc50542c85 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:17.937684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc36fe-6b10-4fe9-9e78-09fc50542c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:18.009635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b7bc36fe-6b10-4fe9-9e78-09fc50542c85 None None] MFA Rules not processed for user `e632ab14fc6d4687bca9af60a4b88241`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:18.010873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b7bc36fe-6b10-4fe9-9e78-09fc50542c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:18.075993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:18.107653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 664/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:18.393395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:18.395308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:18.503772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e94c-796c-45b0-810e-b07429ab9a22 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:18.528339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:18.585688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:18.586293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:18.586576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:18.586875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:18.588435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:18.704405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:18.705826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e40053-6102-4e2d-853b-eb4c469cda55 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:18.724637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 667/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:21.124289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:21.124886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:21.124886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:21.126744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 665/1332] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:21.131889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5d9-3b37-457d-8376-75457bcc1c14 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:21.132305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5d9-3b37-457d-8376-75457bcc1c14 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:21.132440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffe5d9-3b37-457d-8376-75457bcc1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:21.195092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:21.197973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ffffe5d9-3b37-457d-8376-75457bcc1c14 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:21.199707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ffffe5d9-3b37-457d-8376-75457bcc1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:21.295230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 668/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:21.574217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:21.581145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:21.684903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b20dc-120e-4f59-bdd8-cbdea0cc747b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:21.758160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:21.758790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:21.759071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:21.759344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:21.760918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:21.789566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:21.871391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:21.872838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb025a-ef50-4d1c-9323-a5b88767f68e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:21.890461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 666/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:24.082758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:24.083329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:24.083329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:24.084635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 669/1335] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:24.090734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548799-f4a8-462d-b16e-a643408aa62d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:24.091448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548799-f4a8-462d-b16e-a643408aa62d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:24.091448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548799-f4a8-462d-b16e-a643408aa62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:24.171636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-27548799-f4a8-462d-b16e-a643408aa62d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:24.172784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-27548799-f4a8-462d-b16e-a643408aa62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:24.252022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:24.276940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 667/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 16:58:24.564364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:24.565898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:24.676387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4db4b-db28-4fe2-8417-325f6f0f701b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:24.706729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:24.757981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:24.758602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:24.758915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:24.759200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:24.760799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:24.875189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:24.876800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cf699-6cf6-41a3-af97-73b6ef8e5c64 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:24.903574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 670/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:27.454399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:27.454987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:27.454987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:27.456343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 668/1338] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:27.461532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079882-31ce-4567-87f0-171dabf9ba37 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:27.461933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079882-31ce-4567-87f0-171dabf9ba37 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:27.462085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079882-31ce-4567-87f0-171dabf9ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:27.528395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8d079882-31ce-4567-87f0-171dabf9ba37 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:27.529590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8d079882-31ce-4567-87f0-171dabf9ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:27.538465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:27.625004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 671/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:27.912968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:27.914502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:28.019128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66115ac6-1fd4-4c7d-b4a7-c3ee8e12696b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:28.092900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:28.093503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:28.093778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:28.094078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:28.096608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:28.131767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:28.205911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:28.207297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da40dc8-f4a2-4965-a2ca-6ce19a94b41e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:28.225541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 669/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:32.279721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:32.280366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:32.280366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:32.281819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 672/1341] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:32.287309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c958f-674f-4e19-b932-758ef3669b99 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:32.287804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c958f-674f-4e19-b932-758ef3669b99 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:32.288133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c958f-674f-4e19-b932-758ef3669b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:32.362746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5f8c958f-674f-4e19-b932-758ef3669b99 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:32.363960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5f8c958f-674f-4e19-b932-758ef3669b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:32.458401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:32.470418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 670/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:32.755683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:32.757226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:32.864150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a6a0e-0a04-4c95-9cfe-e444220b42f7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:32.904047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:32.942071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:32.942715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:32.943000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:32.943292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:32.944859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:33.063268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:33.064713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15295d5-0528-428b-90cb-49c859d56a16 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:33.084158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 673/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:35.854513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:35.855097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:35.855097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:35.856311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 671/1344] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:35.861825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a789b3-7ec3-4e78-86da-ab3a36301632 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:35.862266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a789b3-7ec3-4e78-86da-ab3a36301632 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:35.862387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a789b3-7ec3-4e78-86da-ab3a36301632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:35.930333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d1a789b3-7ec3-4e78-86da-ab3a36301632 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:35.931590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d1a789b3-7ec3-4e78-86da-ab3a36301632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:35.949557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:36.035142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 674/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:36.324809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:36.326402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:36.436657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef561e88-a9d2-482f-96e1-ed874d47ae29 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:36.511593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:36.512201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:36.512482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:36.512770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:36.514342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:36.558518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:36.626197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:36.627882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c27335-8d84-494b-9d54-4a42e8131eb5 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:36.647553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 672/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:40.889151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:40.889635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:40.889775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:40.893847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 675/1347] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:40.897765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e78-e48f-4c69-ad06-c0e7caffc740 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:40.898216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e78-e48f-4c69-ad06-c0e7caffc740 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:40.898328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7e78-e48f-4c69-ad06-c0e7caffc740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:40.975782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-acee7e78-e48f-4c69-ad06-c0e7caffc740 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:40.976997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-acee7e78-e48f-4c69-ad06-c0e7caffc740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:41.083673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:41.086705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 673/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:41.369272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:41.370829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:41.474702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a6eb-b468-44d7-b423-bfd499658fc6 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:41.523169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:41.548249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:41.548854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:41.549136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:41.549405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:41.551011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:41.659275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:41.660632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e2643-31ef-4dba-8430-5f489e2f41a0 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:41.679060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 676/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:58:46.608841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81901f-ed34-4b1f-8a79-7a12525e5e87 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:46.609300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81901f-ed34-4b1f-8a79-7a12525e5e87 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:46.609698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81901f-ed34-4b1f-8a79-7a12525e5e87 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:46.611397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 674/1350] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:46.617006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7700d3-c0d5-4cdb-839e-e0dd2d618ba5 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:46.617535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7700d3-c0d5-4cdb-839e-e0dd2d618ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:46.617535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7700d3-c0d5-4cdb-839e-e0dd2d618ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:46.719757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3a7700d3-c0d5-4cdb-839e-e0dd2d618ba5 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:46.721682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3a7700d3-c0d5-4cdb-839e-e0dd2d618ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:46.754861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:46.923532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 677/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:51.249071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1438-e70a-4bae-af38-6176e7aadb3e None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:51.249629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1438-e70a-4bae-af38-6176e7aadb3e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:51.249629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1438-e70a-4bae-af38-6176e7aadb3e None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:51.251266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 675/1352] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 16:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:51.256327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bad4ee-1100-4794-97ae-a2658286106b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:51.256770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bad4ee-1100-4794-97ae-a2658286106b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:51.256894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bad4ee-1100-4794-97ae-a2658286106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:51.348257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-79bad4ee-1100-4794-97ae-a2658286106b None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:51.349452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-79bad4ee-1100-4794-97ae-a2658286106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:51.428398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:51.469160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 678/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:52.882073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f0c4-043f-439a-bcb9-3428b34a2fb2 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:52.882636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f0c4-043f-439a-bcb9-3428b34a2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:52.882636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f0c4-043f-439a-bcb9-3428b34a2fb2 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:52.883978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 676/1354] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 16:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:52.889325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a146-d0cd-49f0-a423-9dda7d84dc12 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:52.889767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a146-d0cd-49f0-a423-9dda7d84dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:52.889865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068a146-d0cd-49f0-a423-9dda7d84dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:52.969315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e068a146-d0cd-49f0-a423-9dda7d84dc12 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:52.970519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e068a146-d0cd-49f0-a423-9dda7d84dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:53.090566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 679/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 16:58:56.559238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40f45-c766-49e5-a84c-73f87d7861a5 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:56.559765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40f45-c766-49e5-a84c-73f87d7861a5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:56.559765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40f45-c766-49e5-a84c-73f87d7861a5 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:56.561192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 677/1356] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:56.566785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabc41-57e5-4142-a1d9-e0e752340fb1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:56.567612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabc41-57e5-4142-a1d9-e0e752340fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:56.567891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabc41-57e5-4142-a1d9-e0e752340fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:56.608618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:56.641802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-eeaabc41-57e5-4142-a1d9-e0e752340fb1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:56.643032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-eeaabc41-57e5-4142-a1d9-e0e752340fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:56.745833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 680/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:58:57.048167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:57.048771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:57.049116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:57.050524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 678/1358] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 16:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:58:57.061350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7238-a609-4cac-bdbb-9a2db301fdc4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:57.061844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7238-a609-4cac-bdbb-9a2db301fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:57.062135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7238-a609-4cac-bdbb-9a2db301fdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:57.151595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-bb9e7238-a609-4cac-bdbb-9a2db301fdc4 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:58:57.152803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-bb9e7238-a609-4cac-bdbb-9a2db301fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:57.205438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:57.279188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 681/1359] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 16:58:57.286912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:58:57.288515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:57.459356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef15bab-ab7f-4ea2-96d9-b9de70a965de None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:58:57.546801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:58:57.591817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:58:57.592611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:58:57.592918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:58:57.593189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:58:57.594853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:58:57.703606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:58:57.705342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113806fa-c509-4da8-8e34-9682799e51f6 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:58:57.725768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 679/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:00.138830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:00.139458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:00.139458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:00.141158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 682/1361] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:00.147446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e2a61-1af8-47c7-ba43-92ba262c26e2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:00.147446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e2a61-1af8-47c7-ba43-92ba262c26e2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:00.147446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e2a61-1af8-47c7-ba43-92ba262c26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:00.220309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bb9e2a61-1af8-47c7-ba43-92ba262c26e2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:00.221631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bb9e2a61-1af8-47c7-ba43-92ba262c26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:00.266304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:00.332681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 680/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:00.633592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:00.635132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:00.829885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2d12c-6809-442a-9c7a-a6f55e868143 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:00.845879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:00.969137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:00.969749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:00.970030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:00.970301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:00.971963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:01.067721 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:01.069254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333776-a914-4064-b29d-579cce5ebd39 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:01.088312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 683/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:03.612595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a58f-755b-4ea1-91d3-3229eddfb1d8 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:03.613109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a58f-755b-4ea1-91d3-3229eddfb1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:03.613109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a58f-755b-4ea1-91d3-3229eddfb1d8 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:03.614409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 681/1364] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:59:03.619854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af229-39f5-4134-8042-79bcf950ee1e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:03.620275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af229-39f5-4134-8042-79bcf950ee1e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:03.620405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af229-39f5-4134-8042-79bcf950ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:03.636453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:03.691057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ff4af229-39f5-4134-8042-79bcf950ee1e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:03.692279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ff4af229-39f5-4134-8042-79bcf950ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:03.798067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 684/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:04.103335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:04.103627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:04.103902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:04.105354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 682/1366] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 16:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:04.111931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4604be-7cf2-4981-897d-6e78a6d4f303 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:04.112330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4604be-7cf2-4981-897d-6e78a6d4f303 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:04.112703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4604be-7cf2-4981-897d-6e78a6d4f303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:04.191201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9b4604be-7cf2-4981-897d-6e78a6d4f303 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:04.192410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9b4604be-7cf2-4981-897d-6e78a6d4f303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:04.229045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:04.318063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 685/1367] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:04.327758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:04.329397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:04.491950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c681f-5b1e-4acb-9d66-dee1cbd98b34 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:04.513202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:04.615004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:04.615701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:04.615965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:04.616137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:04.617697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:04.718635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:04.720298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff83caf-2248-4939-8e8f-4fdd7f59e1e2 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:04.754366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 683/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:04.811531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8bac-bd66-45d6-bd05-15843b92fe26 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:04.812068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8bac-bd66-45d6-bd05-15843b92fe26 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:04.812068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8bac-bd66-45d6-bd05-15843b92fe26 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:04.813606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 686/1369] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:04.818896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca21f0-9d91-4886-ae14-63d154cae172 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:04.819190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca21f0-9d91-4886-ae14-63d154cae172 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:04.819467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca21f0-9d91-4886-ae14-63d154cae172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:04.875270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:04.922397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-79ca21f0-9d91-4886-ae14-63d154cae172 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:04.923892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-79ca21f0-9d91-4886-ae14-63d154cae172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:05.039952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 684/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:05.375464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:05.375464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:05.375464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:05.377590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 687/1371] 10.222.0.50 () {54 vars in 963 bytes} [Thu Sep 22 16:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:05.381415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed64-637e-4bf4-a5da-4f0b5f5d5da9 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:05.381995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed64-637e-4bf4-a5da-4f0b5f5d5da9 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:05.382374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed64-637e-4bf4-a5da-4f0b5f5d5da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:05.469043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ee72ed64-637e-4bf4-a5da-4f0b5f5d5da9 None None] MFA Rules not processed for user `997ef7cf46b345d0ab4085d3419cac44`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:05.470419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ee72ed64-637e-4bf4-a5da-4f0b5f5d5da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:05.522122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:05.560091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 685/1372] 10.222.0.50 () {58 vars in 1060 bytes} [Thu Sep 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:05.567985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:05.569707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:05.687917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301face-0563-4a76-90ac-c496b4e9a953 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:05.753447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:05.803868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:05.804834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:05.805344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:05.805815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:05.808164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:05.941859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:05.943575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15312c21-b320-4834-ad0d-8827d97da551 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:05.967357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 688/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:07.022245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:07.022864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:07.022864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:07.024200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 686/1374] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:07.030233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62437e2-cddc-422e-b10d-a64b6082eb92 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:07.030679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62437e2-cddc-422e-b10d-a64b6082eb92 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:07.030842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62437e2-cddc-422e-b10d-a64b6082eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:07.099511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c62437e2-cddc-422e-b10d-a64b6082eb92 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:07.100724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c62437e2-cddc-422e-b10d-a64b6082eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:07.122068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:07.201163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 689/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:07.503960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:07.505778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:07.663136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb110a1-095d-4a99-a73d-6364d3a59b5b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:07.717582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:07.782183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:07.782826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:07.783112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:07.783385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:07.784980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:07.880847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:07.882448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528456a-fe7a-4314-bb70-2b514bfed945 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:07.901864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 687/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:10.132354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:10.133120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:10.133120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:10.134256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 690/1377] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:10.141670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2023c-c32c-460a-9be1-188edfc4a000 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:10.142203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2023c-c32c-460a-9be1-188edfc4a000 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:10.142203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2023c-c32c-460a-9be1-188edfc4a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:10.208021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c8f2023c-c32c-460a-9be1-188edfc4a000 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:10.209218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c8f2023c-c32c-460a-9be1-188edfc4a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:10.216215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:10.309829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 688/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 16:59:10.599386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:10.601069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:10.757565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f26b39-ebb6-4e7e-ab3b-04e9363ace04 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:10.762200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:10.876997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:10.877611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:10.877891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:10.878163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:10.879769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:10.974776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:10.977745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f553ab8-ea46-4f00-b472-1e423b0d6860 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:10.997469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 691/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:13.260715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:13.261876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:13.262027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:13.263700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 689/1380] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:13.269043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649434-eb5c-4c75-98df-68231c4b5f64 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:13.269477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649434-eb5c-4c75-98df-68231c4b5f64 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:13.269654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649434-eb5c-4c75-98df-68231c4b5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:13.281810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:13.340893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b5649434-eb5c-4c75-98df-68231c4b5f64 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:13.342094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b5649434-eb5c-4c75-98df-68231c4b5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:13.470946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 692/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:13.775565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:13.778171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:13.922193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:13.933376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83086e92-5e5a-4754-b186-b277f829fe42 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:14.053019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:14.053703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:14.054054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:14.054325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:14.056511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:14.161039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:14.162739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3c55-06d4-4d0a-b582-bbdbf30093e1 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:14.173813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:14.184737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 690/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:16.484787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:16.485478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:16.485478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:16.486746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 693/1383] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:16.492275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c8a24-6b45-428a-a73b-0634169d5794 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:16.492798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c8a24-6b45-428a-a73b-0634169d5794 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:16.492798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c8a24-6b45-428a-a73b-0634169d5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:16.569473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6e8c8a24-6b45-428a-a73b-0634169d5794 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:16.570731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6e8c8a24-6b45-428a-a73b-0634169d5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:16.676345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 691/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:16.985231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:16.986822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:17.081297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:17.151658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35ccd0-0042-436e-a00b-dfe0e6ba2b71 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:17.288586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:17.289408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:17.289755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:17.290096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:17.292212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:17.356820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:17.405751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:17.407862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dac7e-7f5b-405a-8c87-378dfa7eebb5 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:17.430712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 694/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:19.624892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:19.625506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:19.625506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:19.626831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 692/1386] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:19.632457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66248e-1cc2-4654-a37e-f7dab0e6d677 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:19.632910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66248e-1cc2-4654-a37e-f7dab0e6d677 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:19.633022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66248e-1cc2-4654-a37e-f7dab0e6d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:19.702617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7f66248e-1cc2-4654-a37e-f7dab0e6d677 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:19.703856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7f66248e-1cc2-4654-a37e-f7dab0e6d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:19.803333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 695/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:20.103771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:20.105801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:20.183239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:20.263507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5623b7-c7f4-4d1d-a7b2-023eb2abf4d0 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:20.378392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:20.379034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:20.379311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:20.379581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:20.381150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:20.421373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:20.473707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:20.475344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f68e2e-09e8-4ef7-a009-a761b34aeacd service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:20.493358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 693/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:21.321551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14af04-0e71-4a7f-8d0e-d328d81a74b3 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:21.322143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14af04-0e71-4a7f-8d0e-d328d81a74b3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:21.322143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14af04-0e71-4a7f-8d0e-d328d81a74b3 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:21.323552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 696/1389] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:21.328841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2694b45-33bb-46d5-a19d-55c89473fc90 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:21.329291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2694b45-33bb-46d5-a19d-55c89473fc90 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:21.329389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2694b45-33bb-46d5-a19d-55c89473fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:21.396674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a2694b45-33bb-46d5-a19d-55c89473fc90 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:21.397884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a2694b45-33bb-46d5-a19d-55c89473fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:21.505431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 694/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:21.807876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:21.808314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:21.808593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:21.809981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 697/1391] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 22 16:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:21.815256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b785-a657-475a-a4cc-d731ed63c959 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:21.815547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b785-a657-475a-a4cc-d731ed63c959 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:21.815826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79b785-a657-475a-a4cc-d731ed63c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:21.832161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:21.896149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9b79b785-a657-475a-a4cc-d731ed63c959 None None] MFA Rules not processed for user `d137d89c725440d290a2d63c4c9c67f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:21.897378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9b79b785-a657-475a-a4cc-d731ed63c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:21.982735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 695/1392] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 22 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:21.992230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:21.993824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:22.027982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:22.105381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce98a0-606c-4b16-80fc-3085fac936ef None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:22.180662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:22.181294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:22.181559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:22.181864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:22.183600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:22.265322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:22.306272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:22.307821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dea86-9412-4423-b76d-ff728bc6337d service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:22.327729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 698/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:22.724722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eae05-76c3-446b-8b13-bd176323b6c4 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:22.724722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eae05-76c3-446b-8b13-bd176323b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:22.725230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eae05-76c3-446b-8b13-bd176323b6c4 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:22.726411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 696/1394] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:22.732347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:22.732848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:22.733296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:22.803469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:22.804696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:22.906421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 699/1395] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:23.093374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0345da-967d-412b-bec7-d0200cf06a96 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:23.093666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0345da-967d-412b-bec7-d0200cf06a96 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:23.093996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0345da-967d-412b-bec7-d0200cf06a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:23.161811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ad0345da-967d-412b-bec7-d0200cf06a96 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:23.163128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ad0345da-967d-412b-bec7-d0200cf06a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:23.203190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:23.204429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:23.219194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:23.246097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:23.252604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 697/1396] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:23.302884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02e41-b5ed-4496-915e-2b1e5cc11206 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:23.303172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02e41-b5ed-4496-915e-2b1e5cc11206 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:23.303447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02e41-b5ed-4496-915e-2b1e5cc11206 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:23.304786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 698/1397] 10.222.0.50 () {54 vars in 943 bytes} [Thu Sep 22 16:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 16:59:23.311814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990516f2-5577-465f-92e5-b64b158226ef None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:23.312173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990516f2-5577-465f-92e5-b64b158226ef None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:23.312523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990516f2-5577-465f-92e5-b64b158226ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:23.325965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ae6c9-efa6-4ad5-9459-49bc34b1e86a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:23.392007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-990516f2-5577-465f-92e5-b64b158226ef None None] MFA Rules not processed for user `12e995aeb6d440808a86ca23585ffdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:23.393360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-990516f2-5577-465f-92e5-b64b158226ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:23.444814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:23.445431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:23.445714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:23.445988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:23.447671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:23.482640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:23.504357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 699/1398] 10.222.0.50 () {58 vars in 1040 bytes} [Thu Sep 22 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 16:59:23.515392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990516f2-5577-465f-92e5-b64b158226ef None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:23.525002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990516f2-5577-465f-92e5-b64b158226ef None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:23.542843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:23.544470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b598e8-319c-4afd-99a8-ba02db113ced service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:23.550904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:23.564482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 700/1399] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 16:59:23.634593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:23.635506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:23.635789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:23.636063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:23.637795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:23.736249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:23.738819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5b95-2e10-4f6a-9481-11a213534cb6 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:23.748090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 700/1400] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 16:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 16:59:25.840918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:25.841593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:25.841593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:25.842920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 701/1401] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:25.848437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca587e-0c4d-497b-afb2-d5cc6124cc4d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:25.849346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca587e-0c4d-497b-afb2-d5cc6124cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:25.849849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca587e-0c4d-497b-afb2-d5cc6124cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:25.934032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-85ca587e-0c4d-497b-afb2-d5cc6124cc4d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:25.935296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-85ca587e-0c4d-497b-afb2-d5cc6124cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:25.942859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:26.060597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 701/1402] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:26.369588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:26.371546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:26.556741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad7e83-cc7d-43b3-81d2-808742ece415 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:26.569551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:26.682344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:26.682625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:26.682771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:26.683029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:26.684588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:26.790513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:26.793004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34442e9f-54cf-41ed-9fca-9d181d06cf70 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:26.813417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 702/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:29.032508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:29.033038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:29.033038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:29.034306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 702/1404] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:29.039622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244dca-54a5-4f62-8411-b8c3f4d11ba3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:29.041146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244dca-54a5-4f62-8411-b8c3f4d11ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:29.041429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244dca-54a5-4f62-8411-b8c3f4d11ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:29.064914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:29.122904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3f244dca-54a5-4f62-8411-b8c3f4d11ba3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:29.124157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3f244dca-54a5-4f62-8411-b8c3f4d11ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:29.242701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 703/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:29.532150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:29.533667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:29.691619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:29.702940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734b1f7-3b71-43ef-aecc-3f9faec0ebbb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:29.832583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:29.833209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:29.833579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:29.833917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:29.835634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:29.936556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:29.940250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9eca6-4389-48e2-8f13-3f12514a4a61 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:29.951442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:29.962084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 703/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:32.202490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:32.203073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:32.203073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:32.207005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 704/1407] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 16:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:32.209644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3668-5eed-4757-9a6d-03e110b3ff1c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:32.210084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3668-5eed-4757-9a6d-03e110b3ff1c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:32.210176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3668-5eed-4757-9a6d-03e110b3ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:32.283090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5a4f3668-5eed-4757-9a6d-03e110b3ff1c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:32.284624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5a4f3668-5eed-4757-9a6d-03e110b3ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:32.398415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 704/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:32.694582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:32.696506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:32.794718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:32.857280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243e88a-1727-4098-8ece-73dac0bd339d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:32.987210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:32.987829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:32.988110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:32.988374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:32.989966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:33.057295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:33.093654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:33.095329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8ae6-e6bc-4a76-bc59-804392d0ca9d service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:33.122300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 705/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:42.396716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=67 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:43.112929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=20 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:46.819065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129b15-b3cf-45f9-99d2-fa2b9fc7d31d None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:46.820134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129b15-b3cf-45f9-99d2-fa2b9fc7d31d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:46.820274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129b15-b3cf-45f9-99d2-fa2b9fc7d31d None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:46.821517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 705/1410] 10.222.0.50 () {54 vars in 918 bytes} [Thu Sep 22 16:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:46.826580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718133a-f18c-45f2-9d67-ef120de65cfc None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:46.827021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718133a-f18c-45f2-9d67-ef120de65cfc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:46.827137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718133a-f18c-45f2-9d67-ef120de65cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:46.904538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-4718133a-f18c-45f2-9d67-ef120de65cfc None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:46.905720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4718133a-f18c-45f2-9d67-ef120de65cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:47.014764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 706/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 22 16:59:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:47.030016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648fad-5593-4a68-9a98-bc007a119447 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:47.030309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648fad-5593-4a68-9a98-bc007a119447 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:47.030590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da648fad-5593-4a68-9a98-bc007a119447 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:47.031955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 706/1412] 10.222.0.50 () {54 vars in 918 bytes} [Thu Sep 22 16:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:47.036490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9658c1-3955-4c25-8998-eadf559b021e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:47.036782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9658c1-3955-4c25-8998-eadf559b021e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:47.037061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9658c1-3955-4c25-8998-eadf559b021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:47.110885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:47.114076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ea9658c1-3955-4c25-8998-eadf559b021e None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:47.115847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ea9658c1-3955-4c25-8998-eadf559b021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:47.230542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 707/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 22 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:49.810185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:49.810793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:49.810793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:49.812140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 16:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:49.817516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f4a-8a49-4f96-9568-0c3eecf364ae None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:49.817955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f4a-8a49-4f96-9568-0c3eecf364ae None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:49.818067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce74f4a-8a49-4f96-9568-0c3eecf364ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:49.884690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-cce74f4a-8a49-4f96-9568-0c3eecf364ae None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:49.885898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cce74f4a-8a49-4f96-9568-0c3eecf364ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:49.941369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:49.984845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 16:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:50.277659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:50.279238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:50.424418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ae3b7-a60e-4e71-a175-d587a0d4d179 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:50.497681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:50.537271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:50.537855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:50.538278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:50.538551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:50.540184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:50.628389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:50.630032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec4c84-dafb-416f-acda-56811c9998e8 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:50.649308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 708/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:51.785715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:51.786304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:51.786304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:51.787708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 16:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:51.793828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005b10-5a2f-4549-9361-eef58781e8d8 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:51.794253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005b10-5a2f-4549-9361-eef58781e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:51.794383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae005b10-5a2f-4549-9361-eef58781e8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:51.869505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ae005b10-5a2f-4549-9361-eef58781e8d8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:51.870732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ae005b10-5a2f-4549-9361-eef58781e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:51.897548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:51.967205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 16:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:52.117043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:52.118617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:52.266042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5874-5965-4182-a634-4c9725ee1e31 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:52.306957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:52.378937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:52.379486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:52.379764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:52.380033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:52.381781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:52.472575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:52.474190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab80ba0-84d2-4715-9056-5d232a191bfd service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:52.493005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 710/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:53.628519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:53.629073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:53.629073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:53.630408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 16:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:53.637069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93000-19a0-4bba-b1bd-9970c8f9c6ef None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:53.637490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93000-19a0-4bba-b1bd-9970c8f9c6ef None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:53.637621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93000-19a0-4bba-b1bd-9970c8f9c6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:53.691875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:53.715653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7cd93000-19a0-4bba-b1bd-9970c8f9c6ef None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:53.716869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7cd93000-19a0-4bba-b1bd-9970c8f9c6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:53.814411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 16:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:53.967552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:53.968996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:54.117018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8bdc5-cb66-48a9-bc7f-004235ae47db None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:54.128973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:54.229703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:54.230281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:54.230556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:54.230850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:54.232429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:54.322485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:54.324149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2bb90-e3f6-49fb-895f-0c970e8c0115 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:54.342152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 711/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:55.487039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:55.487616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:55.487616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:55.488911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 16:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:55.495671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2675-29b2-48ef-94af-e55b3fdcee2f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:55.496119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2675-29b2-48ef-94af-e55b3fdcee2f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:55.496234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2675-29b2-48ef-94af-e55b3fdcee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:55.516392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:55.574236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f51a2675-29b2-48ef-94af-e55b3fdcee2f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:55.575508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f51a2675-29b2-48ef-94af-e55b3fdcee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:55.674415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:55.824596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:55.826075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:55.936042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:55.972417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac58a30-471d-4781-8913-5795baf950c8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:56.087486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:56.088016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:56.088299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:56.088581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:56.090161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:56.166896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:56.180821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:56.182408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b88d7-d277-464b-b2be-2c85f6f00f63 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:56.200979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 713/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:57.325621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:57.326216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:57.326216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:57.327521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 16:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:57.334400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cb30-e65f-4763-8bce-29de2bb1c8e7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:57.335355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cb30-e65f-4763-8bce-29de2bb1c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:57.335633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7cb30-e65f-4763-8bce-29de2bb1c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:57.410986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c2e7cb30-e65f-4763-8bce-29de2bb1c8e7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:57.412759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c2e7cb30-e65f-4763-8bce-29de2bb1c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:57.508568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:57.658123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:57.659719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:57.744202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:57.806132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb8873-91f1-442a-8518-0c3b76785e1b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:57.917962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:57.918562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:57.918868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:57.919139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:57.920707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:57.968942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:58.012625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:58.014217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0468df-e43a-4dc3-b6b9-4328b752ca4d service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:58.032034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 714/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 16:59:59.103656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:59.104207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:59.104207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:59.105582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 16:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 16:59:59.112145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f060fa-80a4-4c8c-88d4-3d2519ef55ea None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:59.112619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f060fa-80a4-4c8c-88d4-3d2519ef55ea None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:59.112749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f060fa-80a4-4c8c-88d4-3d2519ef55ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:59.190907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d5f060fa-80a4-4c8c-88d4-3d2519ef55ea None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 16:59:59.192124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5f060fa-80a4-4c8c-88d4-3d2519ef55ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:59.291948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 16:59:59.444462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 16:59:59.445976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:59.495797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:59.594080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb075e7-6e20-492f-b6af-ec058505c4ce None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 16:59:59.709441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 16:59:59.709976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 16:59:59.710260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 16:59:59.710530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 16:59:59.712185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 16:59:59.719199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:59.805299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 16:59:59.806919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003d54-dd68-4ea0-93a8-f7a9e47eceb3 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 16:59:59.825366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 716/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 16:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:00.887732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:00.888310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:00.888310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:00.889612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:00.895930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4752d-4716-46e1-a2d9-383647b9db57 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:00.896597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4752d-4716-46e1-a2d9-383647b9db57 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:00.896597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4752d-4716-46e1-a2d9-383647b9db57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:00.972616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3fb4752d-4716-46e1-a2d9-383647b9db57 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:00.973826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3fb4752d-4716-46e1-a2d9-383647b9db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:01.043193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:01.191442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:01.345124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:01.346592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:01.364576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:01.494493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bac3c2-ed6a-4837-b7bc-7b8f371a6cb6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:01.582751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:01.609111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:01.609647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:01.609925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:01.610199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:01.611828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:01.702668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:01.704302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e5c74-65d2-425f-9299-700090d0f414 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:01.722063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 717/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:02.784347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:02.784778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:02.784901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:02.786242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:02.793735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d923c-47f6-4f41-89bc-3422049035d1 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:02.794187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d923c-47f6-4f41-89bc-3422049035d1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:02.794301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d923c-47f6-4f41-89bc-3422049035d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:02.872284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c39d923c-47f6-4f41-89bc-3422049035d1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:02.873509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c39d923c-47f6-4f41-89bc-3422049035d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:02.916208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:02.970993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:03.121434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:03.122982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:03.268905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db9be6-2bbc-4c1d-8601-bbb51bb63ee4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:03.323001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:03.382948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:03.383475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:03.383755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:03.384026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:03.385861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:03.475035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:03.476618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1478cd-2b4a-44d1-af34-8eb874d2a8f7 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:03.494829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 719/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:04.565569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:04.566148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:04.566148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:04.567562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:04.573963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f67-2881-4ba8-a29d-635e91e4e230 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:04.574458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f67-2881-4ba8-a29d-635e91e4e230 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:04.574578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f67-2881-4ba8-a29d-635e91e4e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:04.649977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-465a1f67-2881-4ba8-a29d-635e91e4e230 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:04.651200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-465a1f67-2881-4ba8-a29d-635e91e4e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:04.653204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:04.747157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:04.896759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:04.898254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:05.044342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b527-dd10-41b2-a176-d9c5dbe20e7f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:05.071501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:05.156937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:05.157462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:05.157739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:05.158008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:05.159629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:05.248719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:05.250324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba1e57-a126-477b-a1c3-f52d4ae99af8 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:05.268785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 720/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:07.352172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:07.352691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:07.352691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:07.353973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:00:07.359372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15a99-9082-4d32-95b4-8f0e6c07dcc7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:07.359800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15a99-9082-4d32-95b4-8f0e6c07dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:07.359930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb15a99-9082-4d32-95b4-8f0e6c07dcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:07.402087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:07.428266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8cb15a99-9082-4d32-95b4-8f0e6c07dcc7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:07.429475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8cb15a99-9082-4d32-95b4-8f0e6c07dcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:07.526743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:07.814942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:07.816462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:07.919494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705b773-1e71-43d5-9b35-d1b204577989 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:07.952048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:07.994648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:07.995279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:07.995558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:07.995831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:07.997409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:08.107444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:08.108788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57da9-c9ed-4cbd-9b18-cbdaf4c30db5 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:08.126604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 722/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:10.434647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:10.435234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:10.435234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:10.436576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:10.442461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5710-e8d4-46da-823c-984e4e9f21de None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:10.442903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5710-e8d4-46da-823c-984e4e9f21de None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:10.443052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf5710-e8d4-46da-823c-984e4e9f21de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:10.508996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9edf5710-e8d4-46da-823c-984e4e9f21de None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:10.510462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9edf5710-e8d4-46da-823c-984e4e9f21de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:10.523716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:10.608664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:10.895320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:10.896902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:10.999951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777449-6060-457b-ab51-8ef9cceabad7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:11.013131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:11.073838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:11.074360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:11.074638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:11.074942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:11.076512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:11.183891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:11.185331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b7590-02b9-46a6-ada6-80de4571b74b service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:11.203142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 723/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:13.646316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:13.646898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:13.646898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:13.648220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:13.653495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08afb0c-849a-4196-ad0f-952d415fefbc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:13.653891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08afb0c-849a-4196-ad0f-952d415fefbc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:13.654054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08afb0c-849a-4196-ad0f-952d415fefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:13.704295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:13.723263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b08afb0c-849a-4196-ad0f-952d415fefbc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:13.724469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b08afb0c-849a-4196-ad0f-952d415fefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:13.819469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:14.106860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:14.108384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:14.211077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1f6a-5a76-4c3c-8200-8007bd5f7b9a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:14.251964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:14.287394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:14.288001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:14.288281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:14.288554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:14.290133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:14.401384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:14.402850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519495f3-5afa-43a0-a3be-23a9d4d6890f service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:14.421204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 725/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:16.697793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:16.698402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:16.698402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:16.699846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:16.705090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43aab-f731-4c76-96bb-3e2130f603eb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:16.705490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43aab-f731-4c76-96bb-3e2130f603eb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:16.705643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43aab-f731-4c76-96bb-3e2130f603eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:16.772467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-14e43aab-f731-4c76-96bb-3e2130f603eb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:16.773667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-14e43aab-f731-4c76-96bb-3e2130f603eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:16.794452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:16.871333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:17.158280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:17.160507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:17.264323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056fcdd-8c3d-43dd-b534-33325bcb2aeb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:17.284254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:17.337534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:17.338133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:17.338413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:17.338709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:17.340273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:17.449605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:17.451082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0854b-5ed6-4275-ab88-0fdc196480e1 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:17.469124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 726/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:19.691358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:19.691927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:19.691927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:19.693260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:19.698730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd813-0a4b-4094-8d17-d758c00f477a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:19.699122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd813-0a4b-4094-8d17-d758c00f477a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:19.699388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd813-0a4b-4094-8d17-d758c00f477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:19.762510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:19.765185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-38ffd813-0a4b-4094-8d17-d758c00f477a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:19.767048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-38ffd813-0a4b-4094-8d17-d758c00f477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:19.863655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:20.149797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:20.151383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:20.255656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb44f88-0358-4cd6-937b-99178b231d69 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:20.304989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:20.329436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:20.330046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:20.330324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:20.330593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:20.332742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:20.442964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:20.444443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50329093-b7c5-4ea9-a15d-8e9895f9dee5 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:20.462559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 728/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:22.730068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:22.730674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:22.730674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:22.731982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:22.737336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4058-a08a-4ba9-9c79-0a8b2c6f49ff None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:22.738161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4058-a08a-4ba9-9c79-0a8b2c6f49ff None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:22.738270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4058-a08a-4ba9-9c79-0a8b2c6f49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:22.806953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-376b4058-a08a-4ba9-9c79-0a8b2c6f49ff None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:22.808172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-376b4058-a08a-4ba9-9c79-0a8b2c6f49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:22.839029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:22.908642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:23.197516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:23.199074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:23.304288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb0c0d-7b91-4224-80eb-d157a0d0542e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:23.332754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:23.378361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:23.379023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:23.379304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:23.379576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:23.381157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:23.488677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:23.490132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ca207-f789-48ec-9d2e-516d69c82fd9 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:23.508846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 729/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:25.756384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:25.756960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:25.756960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:25.758260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:25.764013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4199-8fc3-4c1f-97c1-2111267ed99d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:25.764508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4199-8fc3-4c1f-97c1-2111267ed99d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:25.764618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce4199-8fc3-4c1f-97c1-2111267ed99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:25.835005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8fce4199-8fc3-4c1f-97c1-2111267ed99d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:25.836232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8fce4199-8fc3-4c1f-97c1-2111267ed99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:25.845677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:25.941010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:26.232009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:26.233574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:26.339307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f64d5-5dba-4db1-b93c-42cc7f468d6b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:26.395075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:26.413020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:26.413635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:26.413918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:26.414191 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:26.415802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:26.524510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:26.525898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0dbf7-5a2f-4ec5-ae6e-e5c02aa462a1 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:26.543646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 731/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:28.741998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:28.742595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:28.742595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:28.743839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:28.749062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390a71-dbdf-4064-87fc-2f9723f2bc67 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:28.749529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390a71-dbdf-4064-87fc-2f9723f2bc67 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:28.749638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42390a71-dbdf-4064-87fc-2f9723f2bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:28.817559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-42390a71-dbdf-4064-87fc-2f9723f2bc67 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:28.818091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-42390a71-dbdf-4064-87fc-2f9723f2bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:28.857824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:28.917154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:29.207158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:29.208714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:29.312694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac1f27-5a84-4862-b583-695375af23ce None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:29.351574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:29.386939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:29.387544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:29.387831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:29.388096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:29.389678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:29.495902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:29.497324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ebab2-d675-457c-a1bd-c3dff28a7128 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:29.515176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 732/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:31.709856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:31.710435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:31.710435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:31.711772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:31.717396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50b9d-1a02-42df-a7ed-535111a905f1 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:31.717835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50b9d-1a02-42df-a7ed-535111a905f1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:31.717957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50b9d-1a02-42df-a7ed-535111a905f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:31.784267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-75b50b9d-1a02-42df-a7ed-535111a905f1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:31.785476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-75b50b9d-1a02-42df-a7ed-535111a905f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:31.803690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:31.881888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:32.165499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:32.167103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:32.270327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205ca73-c0f2-43b7-a88a-6c029c1ed2e2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:32.338198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:32.345208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:32.345806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:32.346083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:32.346351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:32.348904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:32.458829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:32.460269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e25fc-b1b1-4b6d-beb9-9807f95ed464 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:32.478737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 734/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:34.662448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:34.663078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:34.663078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:34.664370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:34.669598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6576dd-b908-41f5-8acc-de46253fa723 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:34.670044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6576dd-b908-41f5-8acc-de46253fa723 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:34.670150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6576dd-b908-41f5-8acc-de46253fa723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:34.735518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9d6576dd-b908-41f5-8acc-de46253fa723 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:34.736706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9d6576dd-b908-41f5-8acc-de46253fa723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:34.785974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:34.836645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:35.118895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:35.120422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:35.224390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe3c9-0a90-46e6-9a30-c9ba2208046c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:35.273323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:35.298176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:35.298812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:35.299101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:35.299371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:35.301648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:35.408771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:35.410593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900368f-c4cc-43a7-9cdc-2325084eb29e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:35.429305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 735/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:44.835127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=22 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:45.427063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=66 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:56.106767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed894e-2083-4914-85a2-68e462786a8c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:56.107339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed894e-2083-4914-85a2-68e462786a8c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:56.107339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed894e-2083-4914-85a2-68e462786a8c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:56.108649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 736/1471] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:00:56.113893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c824b0-04fc-4875-8471-6f2d37b8969c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:56.114563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c824b0-04fc-4875-8471-6f2d37b8969c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:56.114563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c824b0-04fc-4875-8471-6f2d37b8969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:56.181773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-53c824b0-04fc-4875-8471-6f2d37b8969c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:56.183028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-53c824b0-04fc-4875-8471-6f2d37b8969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:56.281865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 736/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:56.588738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:56.589028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:56.589309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:56.590680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 737/1473] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 22 17:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:56.595674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1354c-02bd-4a5a-be0d-782ad7cc2cbe None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:56.595965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1354c-02bd-4a5a-be0d-782ad7cc2cbe None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:56.596243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1354c-02bd-4a5a-be0d-782ad7cc2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:56.671954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-afa1354c-02bd-4a5a-be0d-782ad7cc2cbe None None] MFA Rules not processed for user `d137d89c725440d290a2d63c4c9c67f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:56.673153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-afa1354c-02bd-4a5a-be0d-782ad7cc2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:56.693901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:56.748696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 737/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 22 17:00:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:56.756951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:56.758455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:56.861525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b52fb-e4d2-420d-83e5-2748738df47d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:56.935247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:56.935847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:56.936154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:56.936425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:56.937987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:56.992284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:57.049324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:00:57.050797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3f2c-9dd4-40fe-b37d-d47bdcdaf182 service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:00:57.070478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 738/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:59.331167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:59.331736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:59.331736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:59.333004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 738/1476] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:00:59.338396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e0ad-db7c-413f-aff8-4c7ca423d2f5 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:59.338882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e0ad-db7c-413f-aff8-4c7ca423d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:59.338991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e0ad-db7c-413f-aff8-4c7ca423d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:00:59.404734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-be05e0ad-db7c-413f-aff8-4c7ca423d2f5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:00:59.405925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-be05e0ad-db7c-413f-aff8-4c7ca423d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:59.501892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 739/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:00:59.777121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:00:59.778671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:00:59.902626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61d582-3b73-4ebd-b30a-c7aafb19b474 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:00:59.952851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:59.998835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:00:59.999444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:00:59.999727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:00:59.999997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:00.000640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:00.002435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:01:00.002435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:01:00.002435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:01:00.003606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c46c3-2e2f-49be-a2aa-d4a8ea438f24 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:00.023433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 739/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 22 17:00:59 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:01:02.183948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:02.184517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:02.184517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:02.185837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 740/1479] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:01:02.191052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895262-9368-47d7-ab25-f6a81d1548e8 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:02.191493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895262-9368-47d7-ab25-f6a81d1548e8 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:02.191629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2895262-9368-47d7-ab25-f6a81d1548e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:02.258389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f2895262-9368-47d7-ab25-f6a81d1548e8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:01:02.259538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f2895262-9368-47d7-ab25-f6a81d1548e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:02.355004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 740/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:01:02.652285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:01:02.653828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:02.664532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:02.801147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4542e00-6300-4703-87ff-2f00b6e40213 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:01:02.882571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:02.917385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:01:02.917925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:02.918205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:02.918476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:02.920086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:03.012607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:03.014196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8fe0-1552-4675-b486-b49d8da8f192 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:03.032882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 741/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:01:05.377579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:05.378148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:05.378148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:05.379519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 741/1482] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:01:05.385762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f07e8-87e6-4f85-a903-7649705264b4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:05.386209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f07e8-87e6-4f85-a903-7649705264b4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:05.386305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f07e8-87e6-4f85-a903-7649705264b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:05.452698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f81f07e8-87e6-4f85-a903-7649705264b4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:01:05.453915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f81f07e8-87e6-4f85-a903-7649705264b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:05.500090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:05.551205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 742/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:01:05.838500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:01:05.840133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:05.863443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:05.942460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65767092-63db-413b-9cb0-ddfa4a70378c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:01:06.017858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:01:06.018468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:06.018791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:06.019060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:06.021148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:06.094625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:06.129884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:06.131409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce598-356b-47d3-b2ba-8473f81204a7 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:06.149858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 742/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:01:08.375151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:08.375715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:08.375715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:08.377261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 743/1485] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:01:08.383372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01987a8-3ca1-46b6-91e7-9e38f78a283b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:08.383806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01987a8-3ca1-46b6-91e7-9e38f78a283b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:08.383958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01987a8-3ca1-46b6-91e7-9e38f78a283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:08.449952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d01987a8-3ca1-46b6-91e7-9e38f78a283b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:01:08.451205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d01987a8-3ca1-46b6-91e7-9e38f78a283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:08.549407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 743/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:01:08.843614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:01:08.845175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:08.947782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754f584-0c39-4904-9218-e3aac7880039 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:01:09.020540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:09.022881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:01:09.023500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:09.023850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:09.024322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:09.026255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:09.137437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:09.139189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c650-31e2-477c-a23f-03cc195076bf service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:09.157070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 744/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:01:11.490628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:11.491271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:11.491271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:11.492595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 744/1488] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:01:11.498025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab8af-c68d-4a01-bbbd-f8973ece6cf3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:11.498450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab8af-c68d-4a01-bbbd-f8973ece6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:11.498569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab8af-c68d-4a01-bbbd-f8973ece6cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:11.564839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7aeab8af-c68d-4a01-bbbd-f8973ece6cf3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:01:11.566044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7aeab8af-c68d-4a01-bbbd-f8973ece6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:11.619232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:11.663626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 745/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:01:11.956020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:01:11.957546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:11.994843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:12.062549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022a8a-988d-49a4-9425-6a31f3bf641c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:01:12.136000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:01:12.136603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:12.136885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:12.137159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:12.139043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:12.218747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:12.248209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:12.249678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eaafb-152f-4329-ada9-b6f3a0cc8331 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:12.268102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 745/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:01:14.639308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:14.639857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:14.639857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:14.641213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 746/1491] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 22 17:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:01:14.646464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c656d-3bdf-463d-a1df-d38c2fdb6d58 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:14.646969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c656d-3bdf-463d-a1df-d38c2fdb6d58 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:14.647090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c656d-3bdf-463d-a1df-d38c2fdb6d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:14.713926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6a8c656d-3bdf-463d-a1df-d38c2fdb6d58 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:01:14.715943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6a8c656d-3bdf-463d-a1df-d38c2fdb6d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:14.817142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 746/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 22 17:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:01:15.107354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:01:15.108888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:15.213253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a240e-62a1-49c8-ad01-cf9ad3335002 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:01:15.286856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:01:15.287970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:01:15.288252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:01:15.288524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:01:15.290110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:01:15.298642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:15.399798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:01:15.401227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868784c-53cc-4c74-894e-acbe2daa6c0b service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:01:15.419375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 747/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:01:24.815601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=82 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:01:25.417303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=50 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:33.200015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:33.200592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:33.200592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:33.277054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:02:33.278270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:33.376086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 747/1494] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:02:33.384311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:33.384822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:33.384934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:33.460599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:02:33.462256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:33.557738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 748/1495] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:02:33.562377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:33.563619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:33.575475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0c1d6-6151-47ae-9607-cd726c503057 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:33.753792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:33.787479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:33.788086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:33.788363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:33.788629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:33.789846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:02:33.790145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:33.791176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:33.791176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:02:33.791176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:02:33.792057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:33.802940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 748/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:02:33.811374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:33.820445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea814-5edf-4e7f-974c-76ff7f85b3a7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:33.884345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:33.919030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:33.919639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:33.919921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:33.920195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:33.920831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:33.922559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:33.922559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:02:33.922559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:02:33.923790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:33.979961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 749/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:02:33 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:02:33.983797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:33.985319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.019933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b567-7cc9-4814-aa6e-d15e495ecd0b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:34.113614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:34.114217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.114498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.114806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.115446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:34.116460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:34.116460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:02:34.116460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:02:34.117704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:34.159821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 749/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:02:33 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:02:34.163988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:34.166416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.230512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98a7f3-2dce-4832-be8e-46832be75aa3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:34.313759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:34.325525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:34.326141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.326421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.326723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.327365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:34.328410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:34.328410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:02:34.328410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:02:34.329304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:34.342253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 750/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:02:34.346291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:34.347808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.359104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c0ad-4cf4-4c6b-bda4-13a88a0c21bf admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:34.384777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:34.455418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:34.456024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.456303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.456573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.457213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:34.458221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:34.458221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:02:34.458221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:02:34.459139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8755b0-9f6a-473f-9422-ab09ca4e2bca admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:34.472814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 750/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:02:34.477650 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:34.479201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.513098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599de0-3e18-40c4-8971-2f63b4971149 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:34.606795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:34.607409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.607689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.607964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] PATH_INFO: `/v3/projects/a37518aa0a7d413c86b9f12f7994644f/users/60fc9c3d3148463d9e11109e789e7520/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.629981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37518aa0a7d413c86b9f12f7994644f, user_id=60fc9c3d3148463d9e11109e789e7520, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:34.631045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:34.631045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:02:34.631045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:02:34.633006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d8f8d-d853-4562-aafd-a7dc76767cc5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:34.657326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 751/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:02:34 2022] PUT /identity/v3/projects/a37518aa0a7d413c86b9f12f7994644f/users/60fc9c3d3148463d9e11109e789e7520/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:02:34.670459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc560-a796-4c2b-ab24-6a59e792a8f7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.670781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc560-a796-4c2b-ab24-6a59e792a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.671062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc560-a796-4c2b-ab24-6a59e792a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.726466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-394fc560-a796-4c2b-ab24-6a59e792a8f7 None None] MFA Rules not processed for user `60fc9c3d3148463d9e11109e789e7520`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:02:34.728368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-394fc560-a796-4c2b-ab24-6a59e792a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.806338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 751/1502] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:02:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:02:34.819418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.819703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.820005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.822165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 752/1503] 10.222.0.50 () {54 vars in 963 bytes} [Thu Sep 22 17:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:02:34.827007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832818d6-0ef4-4676-a01a-fef647522366 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:34.827317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832818d6-0ef4-4676-a01a-fef647522366 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:34.827590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832818d6-0ef4-4676-a01a-fef647522366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:34.859255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:34.905238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-832818d6-0ef4-4676-a01a-fef647522366 None None] MFA Rules not processed for user `997ef7cf46b345d0ab4085d3419cac44`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:02:34.906435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-832818d6-0ef4-4676-a01a-fef647522366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:34.981611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 752/1504] 10.222.0.50 () {58 vars in 1060 bytes} [Thu Sep 22 17:02:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:02:34.989266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:34.990806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:35.042324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:35.096364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101384-1a0c-464b-a97b-2070ec642719 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:35.169193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:35.169799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:35.170082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:35.170353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:35.171960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:35.271531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:35.272951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:35.277231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:35.292958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 753/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:02:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:02:35.337925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28d1b-7bae-46e8-ac08-ed1827ff1792 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:35.338215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28d1b-7bae-46e8-ac08-ed1827ff1792 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:35.338496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28d1b-7bae-46e8-ac08-ed1827ff1792 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:35.339770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 753/1506] 10.222.0.50 () {52 vars in 830 bytes} [Thu Sep 22 17:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:02:35.343355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:35.344549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:35.443651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13aa72-d974-4b2f-82b7-78a3f0239a06 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:35.536411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:35.537034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:35.537294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:35.537561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] PATH_INFO: `/v3/users/60fc9c3d3148463d9e11109e789e7520` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:35.550353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fc9c3d3148463d9e11109e789e7520)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:35.551393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:35.551393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:02:35.551393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:02:35.552592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:35.562758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:35.620430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fc9c3d3148463d9e11109e789e7520'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:35.628891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fc9c3d3148463d9e11109e789e7520'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:35.629395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fc9c3d3148463d9e11109e789e7520'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:35.629952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fc9c3d3148463d9e11109e789e7520'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:35.644853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fc9c3d3148463d9e11109e789e7520'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:35.672867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 754/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:02:35 2022] DELETE /identity/v3/users/60fc9c3d3148463d9e11109e789e7520 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:02:35.677361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:35.677852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:35.677961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:35.735067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:02:35.736210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:35.813395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:35.827048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 754/1508] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:02:35.837511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:35.838749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:35.939753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327647-2dd6-49fb-beb4-a62036e87f01 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:35.996209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:36.016666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:36.017282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:36.017557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:36.017838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:36.019712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:36.127590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:36.129033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ef161-f715-470d-a22d-d49c50fc0ab1 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:36.147651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 755/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:02:36.474386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:02:36.475639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:02:36.487685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa1feb-5b1a-48ec-9a05-4bfa89edd853 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:02:36.584862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:02:36.585427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:02:36.585703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:02:36.586024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] PATH_INFO: `/v3/projects/a37518aa0a7d413c86b9f12f7994644f` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:02:36.596347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37518aa0a7d413c86b9f12f7994644f)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:02:36.597399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:02:36.597399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:02:36.597399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:02:36.598594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:02:36.656742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37518aa0a7d413c86b9f12f7994644f', 'request_id': 'req-165323eb-01b0-4789-bc14-48eab6e4e889'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:36.669863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37518aa0a7d413c86b9f12f7994644f', 'request_id': 'req-165323eb-01b0-4789-bc14-48eab6e4e889'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:36.678940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37518aa0a7d413c86b9f12f7994644f', 'request_id': 'req-165323eb-01b0-4789-bc14-48eab6e4e889'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:36.701635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] The token cache is being invalidate because project a37518aa0a7d413c86b9f12f7994644f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:02:36.701924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:36.702462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-165323eb-01b0-4789-bc14-48eab6e4e889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:02:36.703830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 755/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:02:36 2022] DELETE /identity/v3/projects/a37518aa0a7d413c86b9f12f7994644f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:02:46.145233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=62 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:46.699589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:04:09.841441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:09.842058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:09.842058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:09.843408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:09.848229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bed21-bd8a-401c-a5c2-fab2dddf2fd0 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:09.848665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bed21-bd8a-401c-a5c2-fab2dddf2fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:09.848774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bed21-bd8a-401c-a5c2-fab2dddf2fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:09.930553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f78bed21-bd8a-401c-a5c2-fab2dddf2fd0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:09.931702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f78bed21-bd8a-401c-a5c2-fab2dddf2fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:10.039081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:10.195902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:10.198042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:10.317381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f1eaa-038c-4e78-a13a-75091fe50e02 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:10.323162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:10.323771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:10.324050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:10.324321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:10.332311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:10.333875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b460b65-6f62-4b10-9c30-5d1306a04b1e service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:10.343494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 757/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:04:11.448648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86362d86-e3f2-47ee-a2a6-a414b48cdc10 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:11.449200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86362d86-e3f2-47ee-a2a6-a414b48cdc10 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:11.449200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86362d86-e3f2-47ee-a2a6-a414b48cdc10 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:11.450512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:11.456779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503d54-c8a4-4dac-899e-1ecd27d27110 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:11.457217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503d54-c8a4-4dac-899e-1ecd27d27110 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:11.457321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503d54-c8a4-4dac-899e-1ecd27d27110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:11.477836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c0503d54-c8a4-4dac-899e-1ecd27d27110 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:11.479065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c0503d54-c8a4-4dac-899e-1ecd27d27110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:11.487045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:11.644423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86362d86-e3f2-47ee-a2a6-a414b48cdc10 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:11.659262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86362d86-e3f2-47ee-a2a6-a414b48cdc10 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:11.665547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:11.666150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:11.666431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:11.666744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:11.683828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:11.686894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f40213-6539-47c6-ac04-28ac5c90ab92 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:11.702783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 758/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:12.165944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f721b-0549-4d62-a01b-2bf52569d9a7 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:12.166229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f721b-0549-4d62-a01b-2bf52569d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:12.166506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f721b-0549-4d62-a01b-2bf52569d9a7 None None] PATH_INFO: `/v3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:12.167809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 759/1517] 10.222.0.42 () {54 vars in 925 bytes} [Thu Sep 22 17:04:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:04:12.174373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511f1c-bcb7-4bff-97f3-8dd2537ca45e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:12.174683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511f1c-bcb7-4bff-97f3-8dd2537ca45e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:12.174974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab511f1c-bcb7-4bff-97f3-8dd2537ca45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:12.234481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ab511f1c-bcb7-4bff-97f3-8dd2537ca45e None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:12.235783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ab511f1c-bcb7-4bff-97f3-8dd2537ca45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:12.252382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:04:12.307502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 759/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 22 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:15.920142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550dbf-3298-4849-bf2d-05652ab24004 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:15.920627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550dbf-3298-4849-bf2d-05652ab24004 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:15.920747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550dbf-3298-4849-bf2d-05652ab24004 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:15.922064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 760/1519] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 17:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:15.927074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f932070-5be1-45b7-aea3-f9b261b262c0 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:15.927498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f932070-5be1-45b7-aea3-f9b261b262c0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:15.927641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f932070-5be1-45b7-aea3-f9b261b262c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:15.949592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4f932070-5be1-45b7-aea3-f9b261b262c0 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:15.950828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4f932070-5be1-45b7-aea3-f9b261b262c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:15.959261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 760/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:15.967798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550dbf-3298-4849-bf2d-05652ab24004 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:15.983058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550dbf-3298-4849-bf2d-05652ab24004 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:15.988248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:15.988868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:15.989153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:15.989452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:15.998571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:16.000214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56728-4520-4849-b8a5-d0bff7f64e06 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:16.009922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 761/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:23.258467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9468-389b-4c8e-953f-34bf4cf22430 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:23.259084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9468-389b-4c8e-953f-34bf4cf22430 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:23.259084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9468-389b-4c8e-953f-34bf4cf22430 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:23.260432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:23.266929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865591-c78e-47db-b891-7f1422cfae30 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:23.267409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865591-c78e-47db-b891-7f1422cfae30 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:23.267510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75865591-c78e-47db-b891-7f1422cfae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:23.287741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-75865591-c78e-47db-b891-7f1422cfae30 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:23.289296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-75865591-c78e-47db-b891-7f1422cfae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:23.297994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:23.453654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9468-389b-4c8e-953f-34bf4cf22430 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:23.469584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9468-389b-4c8e-953f-34bf4cf22430 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:23.474906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:23.476150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:23.476429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:23.476698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:23.484728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:23.486296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad8d6-c94e-4501-9a3f-187f7e17e5d6 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:23.495679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 762/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:24.605149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe866-89b9-41cb-98df-2e190d17db95 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:24.605727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe866-89b9-41cb-98df-2e190d17db95 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:24.605727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe866-89b9-41cb-98df-2e190d17db95 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:24.607077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 17:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:24.613421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c072-19bd-4d37-a6df-d124cba38b14 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:24.613875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c072-19bd-4d37-a6df-d124cba38b14 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:24.614011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c072-19bd-4d37-a6df-d124cba38b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:24.633775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9530c072-19bd-4d37-a6df-d124cba38b14 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:24.635013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9530c072-19bd-4d37-a6df-d124cba38b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:24.642795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:24.795181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe866-89b9-41cb-98df-2e190d17db95 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:24.809893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe866-89b9-41cb-98df-2e190d17db95 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:24.815416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:24.816015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:24.816299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:24.816577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:24.825176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:24.826770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9294f-0286-45a1-8fa2-b487b486bdfe service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:24.836512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 764/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:28.763121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:28.763668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:28.763821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:28.765044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:28.770347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098dc6-d00c-46e2-8ad7-4e4b3defac31 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:28.770795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098dc6-d00c-46e2-8ad7-4e4b3defac31 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:28.770941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098dc6-d00c-46e2-8ad7-4e4b3defac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:28.791381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e4098dc6-d00c-46e2-8ad7-4e4b3defac31 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:28.792569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e4098dc6-d00c-46e2-8ad7-4e4b3defac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:28.800360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:29.095303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:29.097036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:29.183292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e49d50-a624-4a05-a454-c7f0ed45dd86 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:29.186869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:29.187479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:29.187759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:29.188030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:29.196774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:29.198204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ef672-f48b-418d-97f3-10a4a1af996b service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:29.207459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 765/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:31.354687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7b74-0a38-44cb-91d4-6f17c80d8013 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:31.355225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7b74-0a38-44cb-91d4-6f17c80d8013 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:31.355225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd7b74-0a38-44cb-91d4-6f17c80d8013 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:31.356495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:31.361700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dca3-b5ca-4e7a-8045-44b75f3e1dfd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:31.362149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dca3-b5ca-4e7a-8045-44b75f3e1dfd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:31.362283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2dca3-b5ca-4e7a-8045-44b75f3e1dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:31.382719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-04d2dca3-b5ca-4e7a-8045-44b75f3e1dfd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:31.383918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-04d2dca3-b5ca-4e7a-8045-44b75f3e1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:31.391680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:31.682531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7b74-0a38-44cb-91d4-6f17c80d8013 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:31.692992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd7b74-0a38-44cb-91d4-6f17c80d8013 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:31.697068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:31.697666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:31.697946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:31.698221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:31.706930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:31.708341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8ab3-9cd3-4816-98d3-2345256ce209 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:31.717699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 767/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:35.434157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:35.434796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:35.434796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:35.436046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:35.441175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4aa1-831c-49b2-a20a-b62d1152e714 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:35.441608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4aa1-831c-49b2-a20a-b62d1152e714 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:35.441814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4aa1-831c-49b2-a20a-b62d1152e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:35.461836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-994b4aa1-831c-49b2-a20a-b62d1152e714 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:35.463116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-994b4aa1-831c-49b2-a20a-b62d1152e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:35.470874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:35.780467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:35.782133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:35.846442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:04:35.859805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a244c-834d-4e1b-a25c-39a5cafcb2e9 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:35.863261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:35.863863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:35.864139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:35.864414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:35.873179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:35.874590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334213a-2e3a-4b5f-b3bc-76e068aa7723 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:35.884296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 768/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:38.033316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:38.033838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:38.033951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:38.035232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 17:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:04:38.041318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3d78a-cd56-45fe-ae9f-0ea1798d245c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:38.041757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3d78a-cd56-45fe-ae9f-0ea1798d245c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:38.041895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3d78a-cd56-45fe-ae9f-0ea1798d245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:38.061962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a7f3d78a-cd56-45fe-ae9f-0ea1798d245c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:04:38.063180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a7f3d78a-cd56-45fe-ae9f-0ea1798d245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:38.071186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:04:38.379662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:04:38.381450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:04:38.389790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=84 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:04:38.396261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0452b30-9ae1-4622-8f0f-ad7ea18cc311 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:04:38.400903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:04:38.401524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:04:38.401803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:04:38.402075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:04:38.411759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:04:38.413918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15618e6c-d352-4d58-a10a-b05173482d42 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:04:38.424232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 770/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:04:48.057075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=11 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:04:48.419733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:07.851233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b7c-4311-45c2-b863-8b084fde9c8d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:07.851896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b7c-4311-45c2-b863-8b084fde9c8d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:07.851896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed9b7c-4311-45c2-b863-8b084fde9c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:07.875120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e9ed9b7c-4311-45c2-b863-8b084fde9c8d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:07.876442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e9ed9b7c-4311-45c2-b863-8b084fde9c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:07.890885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 770/1540] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:07.901184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:07.901817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:07.901817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:07.935977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:07.937409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:07.942811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7b44-d08a-49f8-90bc-ebc74b2958dc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:07.943087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7b44-d08a-49f8-90bc-ebc74b2958dc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:07.943358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7b44-d08a-49f8-90bc-ebc74b2958dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:07.946112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 771/1541] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:07.950278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:07.960878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1153-6fa6-4d6e-94ca-25a6db8dbdf1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:07.965876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:07.966590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:07.966912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:07.967189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:07.967844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:07.968153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:07.969174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:07.969174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:06:07.969174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:06:07.970056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:07.990947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 772/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:06:07.999113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-202a7b44-d08a-49f8-90bc-ebc74b2958dc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.000360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-202a7b44-d08a-49f8-90bc-ebc74b2958dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.007429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.022076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 771/1543] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 22 17:06:08.023771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6759f-9a06-4a9a-8adf-934d7d887ada admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.030908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.031179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c4ef-865f-42bf-a554-ebd3aeba6e00 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.031434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c4ef-865f-42bf-a554-ebd3aeba6e00 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.031554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.031710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c4ef-865f-42bf-a554-ebd3aeba6e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.031822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.032068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.032729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.035505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.070986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7624c4ef-865f-42bf-a554-ebd3aeba6e00 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.072208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7624c4ef-865f-42bf-a554-ebd3aeba6e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.098401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 772/1544] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:08.099874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.100145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.100422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.108674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 773/1545] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:08.113347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.134114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.135341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.245198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c968-ce55-4882-be48-0d1a34895066 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.255570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.256204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.256488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.256764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.257415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.258544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:08.258544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:06:08.258544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:06:08.260753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc49f-4da7-480d-84ee-37492e590fdc admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.279789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 773/1546] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.279789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.293364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 774/1547] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:08.294257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b339d4-7eea-482b-b042-91eccf78a01f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.296033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b6f0-9810-41cc-bf8f-762cdbc426a0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.296560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b6f0-9810-41cc-bf8f-762cdbc426a0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.296849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b6f0-9810-41cc-bf8f-762cdbc426a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.301852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.303384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.304089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.304585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.305501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.306103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.308150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c13f7-49ae-4c3c-89a2-d32ed0263216 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.323722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 774/1548] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.325385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f291-4605-47ad-a6ed-39bd95b108df None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.325871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f291-4605-47ad-a6ed-39bd95b108df None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.326337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f291-4605-47ad-a6ed-39bd95b108df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.335965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ba84b6f0-9810-41cc-bf8f-762cdbc426a0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.337268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ba84b6f0-9810-41cc-bf8f-762cdbc426a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.345346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 775/1549] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.346563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.346881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.347157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.347818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ca91f291-4605-47ad-a6ed-39bd95b108df None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.349060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ca91f291-4605-47ad-a6ed-39bd95b108df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.357154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 775/1550] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.358614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07804-c453-4eb7-af21-1afd3fa367aa None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.359043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07804-c453-4eb7-af21-1afd3fa367aa None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.359574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07804-c453-4eb7-af21-1afd3fa367aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.366899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.368103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.376035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 776/1551] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.376984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.383892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-79a07804-c453-4eb7-af21-1afd3fa367aa None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.385106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-79a07804-c453-4eb7-af21-1afd3fa367aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.387639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e684a9-1e93-43bb-9419-995a5769b11a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.392481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.393851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.394138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.394507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.394628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 776/1552] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.395296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.395704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.396245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.396518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.397167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdfeeb-4ee1-498e-9239-4386ca7c5e2a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.408229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 777/1553] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:08.410120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039523-56b6-4a4e-b62b-db00d44c139d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.410413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039523-56b6-4a4e-b62b-db00d44c139d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.410712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039523-56b6-4a4e-b62b-db00d44c139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.417527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.418737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.427426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 777/1554] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.428194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.430713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8e039523-56b6-4a4e-b62b-db00d44c139d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.432014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8e039523-56b6-4a4e-b62b-db00d44c139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.437787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d940d7-453c-4d79-bcf4-b30c5a529f6d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.442758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 778/1555] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.442758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704721-98d9-4197-9361-515cc3dfa3c8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.442758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704721-98d9-4197-9361-515cc3dfa3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.442758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704721-98d9-4197-9361-515cc3dfa3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.445078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.445787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.446065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.446333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.447333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.448345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:08.448345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:06:08.448345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:06:08.449516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc3cf-833d-4a6c-96fe-8638bedd9953 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.461552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6f704721-98d9-4197-9361-515cc3dfa3c8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.462771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6f704721-98d9-4197-9361-515cc3dfa3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.471366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 779/1556] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.475433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.475433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.475433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.481824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 778/1557] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:08.481824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.481824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.481824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.495507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.496733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.501166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.503086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.561695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 780/1558] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.562749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.567486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 779/1559] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.567632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:08.568306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.577416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5f22-24f3-4e70-98f6-9671ca7744e9 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.578097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4254b-5168-4a77-8e18-24f39a08e86f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.582219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.582846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.583133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.583277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.583401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.583877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.584043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.584159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.584410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.585049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.585355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.585647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8621c-8858-49da-a7d3-e2818cc993f5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.586968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b56713-a540-4f2f-a192-b3ffee85ffe2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.595798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 780/1560] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:08.597627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.597913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.598188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.600280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 781/1561] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.601553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.601838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.602108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.617880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.619121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.621765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:08.622979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:08.627917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 781/1562] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.628729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.633918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 782/1563] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:08.634753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.642418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20854bb-8e58-45a4-b117-9d94bb5f150e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.645147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654049-a736-4d09-bee6-e02531f3f36c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.647901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.648504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.648784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.649061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.649698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.650002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.650334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.650965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.651245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.651521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.651669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.652152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.654085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.654233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:08.664881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 782/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.665963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.679157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 783/1565] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:08.679157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.682258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660a6a-fff2-476d-8157-9f63c256e483 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.686302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81def58-5943-4eb9-b713-655100b8de66 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.687366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.687968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.688251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.688526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.689163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.689464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.691350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.691545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.692145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.692435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.692717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.693355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.693663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.695273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.704453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 783/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.706634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.708938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 784/1567] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.709925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.717454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5e195-8fc2-4482-8676-eaf44885f132 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.723074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.723732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.724011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.724286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] PATH_INFO: `/v3/projects/6434fcff873348b8b0aff8633dcd1feb/users/ebb6142f6a3f41e4af6f109b31dfc9a7/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.725600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec562852-dc71-4d3d-9c59-771c001d5d8d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.731188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.731911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.732338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.732620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.733252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.735238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.740467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6434fcff873348b8b0aff8633dcd1feb, user_id=ebb6142f6a3f41e4af6f109b31dfc9a7, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.741494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:08.741494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:06:08.741494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:06:08.743476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.756850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 784/1568] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:08 2022] PUT /identity/v3/projects/6434fcff873348b8b0aff8633dcd1feb/users/ebb6142f6a3f41e4af6f109b31dfc9a7/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:08.761243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.766086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 785/1569] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:08.766086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.828526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca861-75c2-4eaa-b39f-83b18fa5916d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.832289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ae85-168f-4ac5-b9db-1cab067f29d6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.833846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.834457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.834773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.835049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.835696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.836006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.837043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.837609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.837717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.837941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.838215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.838917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:08.839219 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.840798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.849905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 785/1570] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.850880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.862079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 786/1571] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:08.862079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.863373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00cffc-e3ff-4ff1-a0ef-d296684d68bc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.868514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.869069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.869358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.869639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.870270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.871711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba348cf2-ef51-4b4c-aaed-9b0cd635902d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.872222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.876358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.876962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.877388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.877663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.878483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.880080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.890749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 787/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:08.892060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.905637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 786/1573] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:08.905637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:08.905926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62037d-1665-41c8-a96b-460b31e0159b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.962633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.963271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.963554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.963825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.964458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.966360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6162b8-2b84-42c5-bf69-8657bde28178 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.967103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1e3a-c91d-42fb-9f97-d119118aa5b3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:08.971811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:08.972419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:08.972703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:08.972981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:08.973616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:08.977992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:08.991771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.003920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 788/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.005277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.005566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.005844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.007763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 787/1575] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:08 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.008570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.026601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:09.027835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:09.030111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.077361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274353fb-ed1c-4ee1-ba33-cf1f1e75f5f2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.082843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.083452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.083733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.084005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.084633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.086541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.088680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 789/1576] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:09.090255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.102980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4ea42-ffbd-4089-adba-3f95bb74d0c9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.110357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.111014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.111294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.111688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.111926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 788/1577] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.113038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.115082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.115633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.125355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32418f-f165-4f68-8571-15055f14e4d4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.130640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.131363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.131647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.131921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.132564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.134484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.143129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 790/1578] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.144523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.164492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 789/1579] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.165607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.213542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af786-50d1-4c5e-ad01-0370afc90521 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.228268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d6ef-112d-4fac-8e9a-619fcbb29283 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.232893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.233498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.233781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.234056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.234712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.236682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.261285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 790/1580] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.261285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.268721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb404b9-ded3-42c2-9219-2e4731cc33e9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.273479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.273639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.274094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.274231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.274359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.274446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.274627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.274754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.275290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.275418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.276944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.277215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.288094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 791/1581] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.288878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.300286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682653c9-03e6-42f2-8161-8d91901e81b6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.301748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 791/1582] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.304974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.308509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.309120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.309406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.309684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.310318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.312310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.335770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 792/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.336668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.341828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.349141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2108d1-cb3a-43f1-86f1-b2a0dd31330f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.354216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.354854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.355139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.355418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.356061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.357665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.359299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f06ba6-d05f-4aac-9a0c-5d4076f7295e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.363946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.364173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.364456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.364732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.369454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 793/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.370240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.376109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.377491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.379911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c33e77-6d4b-4794-a36a-87bf2e5db3ef admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.381701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.384969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.385560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.385846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.386124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.386786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.388684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.389700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 792/1585] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:09.390494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.401401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e735a-5a97-434a-8108-a8fcf0c89b7a service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.406318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.406931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.407259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.407533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.408224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.410956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.416234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 794/1586] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.416234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.425775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a98d-a1bd-48a9-9d02-1b081d3204a5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.430911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.431546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.431795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.432070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.432849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.437716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 793/1587] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:09.437876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.437986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.447414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569885af-2f59-4ab4-973e-6b00cbdea3fe admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.448488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 795/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.449276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.453007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.453672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.453957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.454243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] PATH_INFO: `/v3/projects/91830b00885e45d386f1842186cd2df3/users/ecffd903517544248689e4ad7a1846f7/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.461323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e5f6d-a702-41b0-82a6-ca6d49f1f03b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.467229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.467910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.468185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.468459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.469101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.470856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.472396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91830b00885e45d386f1842186cd2df3, user_id=ecffd903517544248689e4ad7a1846f7, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.477023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.486722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 796/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.486722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.492141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 794/1590] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:09 2022] PUT /identity/v3/projects/91830b00885e45d386f1842186cd2df3/users/ecffd903517544248689e4ad7a1846f7/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:09.496763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.497865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8606c8-055e-45aa-8918-af7e6bf262a9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.567213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.568063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.568198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbc965-3850-4416-abd7-1f3256d57b22 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.568466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.568806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.569524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.571228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.573780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.574461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.574848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.575200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.575903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.577568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.583423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 797/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.584500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.590736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 795/1592] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.591785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.600394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94580c-7b9c-4073-872d-f33297fcf257 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.604419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb71b-5893-49fa-9dca-c95618c5f394 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.605155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.605763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.606128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.606319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.607021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.608878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.610253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.611290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.612354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.612727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.613566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.615997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.621129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 798/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.621812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.632146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c2c3-2269-4009-a809-a68f024c293d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.633078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 796/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.634953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.637373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.637984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.638266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.638541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.639326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.640921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b41d-aa84-46b0-9ee2-7641b707cede admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.650348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5df5fe-793d-4189-be6d-37275d454fe2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.656614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.656614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.656614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.657225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.657415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.658984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 799/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.659717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.663540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.663880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.664216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.675641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 797/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.676555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.686472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:09.687744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:09.688281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2500def-be32-4566-87bd-29b609c5fbad admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.693821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.694436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.694785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.695066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.696064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.696192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 800/1597] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:09.699704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.699821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.714711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556a062-7e1b-4c51-bbab-2673595579f4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.716602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 798/1598] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.717462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.723785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.724467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.724750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.725023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] PATH_INFO: `/v3/projects/96a82f69df524ab9977f54bbed079c56/users/0f915e1541084ef88223a405a0536ffc/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.728087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a552b3-5425-43dd-bd92-11c2e7eeab88 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.734012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.738202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.738202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.738202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.738202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.749425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a82f69df524ab9977f54bbed079c56, user_id=0f915e1541084ef88223a405a0536ffc, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.749955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.753184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.765538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 799/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.765538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.776956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9829-970d-4197-9f9b-da1e27a88e36 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.777879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 801/1600] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:09 2022] PUT /identity/v3/projects/96a82f69df524ab9977f54bbed079c56/users/0f915e1541084ef88223a405a0536ffc/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:09.779055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.852934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.853698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.854050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.854492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.855232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.856847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.860356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.866328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6f33-4e00-44c7-b34e-008266309e6c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.871643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 800/1601] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:09.871643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.872311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.873053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.873390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.873708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] PATH_INFO: `/v3/projects/33235763fc8e4ec298109d5b58c34d7c/users/071e49ba214a4ff1be50157f514fc2db/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.879866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:09.884449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada0670-3aae-43c5-a62a-42a40344cbe5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:09.890967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:09.892196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:09.892196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:09.892422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] PATH_INFO: `/v3/projects/abb75c5f2c0741619a5b43d5d0a21b8b/users/2f55f3bbe4354815869346312fb1db60/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:09.893301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33235763fc8e4ec298109d5b58c34d7c, user_id=071e49ba214a4ff1be50157f514fc2db, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.896352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.911140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 802/1602] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:09 2022] PUT /identity/v3/projects/33235763fc8e4ec298109d5b58c34d7c/users/071e49ba214a4ff1be50157f514fc2db/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:09.911980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.915984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:09.916470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb75c5f2c0741619a5b43d5d0a21b8b, user_id=2f55f3bbe4354815869346312fb1db60, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:09.920108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:09.939189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 801/1603] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:09 2022] PUT /identity/v3/projects/abb75c5f2c0741619a5b43d5d0a21b8b/users/2f55f3bbe4354815869346312fb1db60/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:09.941897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:09.986113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe4f8-9526-4b3a-8376-66b53d52b8c3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.026841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28cdbb-7f37-46b0-b40c-8e0ae20e8bd3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.032207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.032884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.034349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.034692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] PATH_INFO: `/v3/projects/059acbd9ea3e4aa5863fcbac64fbecb2/users/071a117b156f46b0b3afb5c47b3baef2/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.050695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=059acbd9ea3e4aa5863fcbac64fbecb2, user_id=071a117b156f46b0b3afb5c47b3baef2, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.052119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.052828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.053116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.053348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.053463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.066395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.067750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 802/1604] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:09 2022] PUT /identity/v3/projects/059acbd9ea3e4aa5863fcbac64fbecb2/users/071a117b156f46b0b3afb5c47b3baef2/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:10.068222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd412c7a-66d2-4d78-b428-15ed1e34ce0b service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.072603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.079119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 803/1605] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:10.080572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.080857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.081152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.101099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.102327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.156737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65381cba-8389-44cb-8edf-ea92f5c739e9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.162286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.162973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.163406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.163689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] PATH_INFO: `/v3/projects/e06a716f68c34a6d9e20c7b978008324/users/8f16d27a3b564155aaa3b459daaea6cf/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.171839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 804/1606] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.172897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.184012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85bb28-df75-4276-a9b7-b4b7876191d7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.189096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.190324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.190726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.191016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] PATH_INFO: `/v3/projects/c1e5e9e000ee4ae497b93981b39865e1/users/444e0c429cf240c98f584bd00afdf790/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.191877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06a716f68c34a6d9e20c7b978008324, user_id=8f16d27a3b564155aaa3b459daaea6cf, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.195548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09b644-3863-4caa-9c33-6510893e6a75 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.210320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e5e9e000ee4ae497b93981b39865e1, user_id=444e0c429cf240c98f584bd00afdf790, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.213077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc7ae0-cd9a-46bd-93c2-4246ea3566fe admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.225708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 803/1607] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:10 2022] PUT /identity/v3/projects/e06a716f68c34a6d9e20c7b978008324/users/8f16d27a3b564155aaa3b459daaea6cf/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:10.225708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8eaa-6071-4056-83ac-f2742dd4863b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.225708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8eaa-6071-4056-83ac-f2742dd4863b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.225708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8eaa-6071-4056-83ac-f2742dd4863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.247606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 805/1608] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:10 2022] PUT /identity/v3/projects/c1e5e9e000ee4ae497b93981b39865e1/users/444e0c429cf240c98f584bd00afdf790/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:10.247606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.247606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.247606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.254505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-726c8eaa-6071-4056-83ac-f2742dd4863b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.256102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-726c8eaa-6071-4056-83ac-f2742dd4863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.275155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:10.279934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] MFA Rules not processed for user `2f55f3bbe4354815869346312fb1db60`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.282386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.332559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:10.371719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 804/1609] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.373147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb6bc-d650-4813-8696-f1959bdfa9f6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.373528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb6bc-d650-4813-8696-f1959bdfa9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.373915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deb6bc-d650-4813-8696-f1959bdfa9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.397249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e5deb6bc-d650-4813-8696-f1959bdfa9f6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.398882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e5deb6bc-d650-4813-8696-f1959bdfa9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.402643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 806/1610] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.404486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.420608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 805/1611] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.423035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.423415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.423790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.479625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] MFA Rules not processed for user `8f16d27a3b564155aaa3b459daaea6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.480932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.497838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0a01-d73b-460d-934a-b25dac5d2f0c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.504547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.505934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.506299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.506648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.518769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.521919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5aff9-eeae-43eb-bfc6-ea26bf25865e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.534082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 807/1612] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:10.536295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.536684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.537107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.587840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] MFA Rules not processed for user `444e0c429cf240c98f584bd00afdf790`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:10.590514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:10.606715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 806/1613] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.613336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.629526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726b46-1674-4d09-8eeb-5628b67b043a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.635593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.636417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.636765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.637213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.637948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:10.640023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:10.681198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 807/1614] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:10.684459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.780944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 808/1615] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:10.782567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:10.792151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5009fd-fdad-432e-a321-a500ba3bb059 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.807130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.809237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.809627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.810529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.812213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9fd41-b14e-44ae-9920-c7d4df904219 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:10.826119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:10.829106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:10.832166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:10.832848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:10.941417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:11.016519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.024510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.030163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:11.040410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 808/1616] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:11.041222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.051263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.052829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.054759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5abf98-c8ba-48f6-bffa-b5fafbbae7b3 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.063239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.064287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.066187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.066627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.067671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.070231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.082288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 809/1617] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:11.083046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.130494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148b48-f811-43d2-9ef7-840d68360710 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.132717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 809/1618] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:11 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:11.134559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.269740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317626b-b71b-4eb7-8f75-0d93b87dcf8c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.270307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.271746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.272174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.272572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.273308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.275531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.277109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.277888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.278179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.278570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.279259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.281376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.324116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 810/1619] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:11 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:11.325791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.338855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 810/1620] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:11 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:11.339802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.358269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2bdad-7052-433a-9152-bf68e5d163c0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.451705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.452376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.452659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.452930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.453616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.457614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.480303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963c58-a04e-448f-98c6-86080ee78d63 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.490263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.495000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.495173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 811/1621] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:11 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:11.496103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.496796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.497097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.498902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.502370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.509691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993f43d-e6bd-4952-bcae-9f8816824056 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.517187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.519019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.519479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.519762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.520515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.523025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.537424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 811/1622] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:11.538690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.554727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 812/1623] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:11 2022] POST /identity/v3/users => generated 309 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:11.555689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.567387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89ddcc-5d54-40ea-9d29-9a874a328e03 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.571153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d96aa-c5a0-4aff-8545-ad441c198b00 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.576876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.577040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.577827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.578111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.578634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] PATH_INFO: `/v3/projects/b156dc573bd942a38731b0030cd5deab/users/92e907ff7fe24e0cae65a28802c6c472/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.579064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.579366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.581282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.584532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.588568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.616104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 812/1624] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:11.616817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.637392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b156dc573bd942a38731b0030cd5deab, user_id=92e907ff7fe24e0cae65a28802c6c472, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.641041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fd968-393c-4d79-b733-c4231fb932d3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.644228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.646871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.647549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.647833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.648106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.648966 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.650789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.671057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 813/1625] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:11.672246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.679581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 813/1626] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:11 2022] PUT /identity/v3/projects/b156dc573bd942a38731b0030cd5deab/users/92e907ff7fe24e0cae65a28802c6c472/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:11.682640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.691106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268de9-057f-4d2b-a2b3-bb648f8310ac admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:11.710803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:11.746027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:11.789014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:11.791053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:11.792161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:11.793181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] PATH_INFO: `/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58/users/7bf9740d5dd742fd90f13dee8597ea3b/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:11.815496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2413f283b24b8caa94a0c5f9b58e58, user_id=7bf9740d5dd742fd90f13dee8597ea3b, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:11.819523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:11.842518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 814/1627] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:11 2022] PUT /identity/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58/users/7bf9740d5dd742fd90f13dee8597ea3b/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:11.843901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:11.897413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941969b-0c14-45d2-aa66-b8f779433e94 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.049825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fc30f-bb61-4b29-b3ab-baafaa6f603a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.063520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.065828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.066432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.066888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.068491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.070518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.090419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 815/1628] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:12.091708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.131305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.134438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.136240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.136992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] PATH_INFO: `/v3/projects/51fa5e97c2f7488896f260769d703ec1/users/82936c8f488945a0bedd04ff0e0ed1aa/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.153210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7782-5875-4785-bbc0-24cd5f1f870d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.167637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.169139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.169597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.170037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.172638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.173002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fa5e97c2f7488896f260769d703ec1, user_id=82936c8f488945a0bedd04ff0e0ed1aa, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.178481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.183244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.210507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 816/1629] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:12.213238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.220359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 814/1630] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:11 2022] PUT /identity/v3/projects/51fa5e97c2f7488896f260769d703ec1/users/82936c8f488945a0bedd04ff0e0ed1aa/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:12.222969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.240129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5a87c-cc9a-44b4-b85a-ce722d868fff admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.403474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.404175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.404462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.404743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] PATH_INFO: `/v3/projects/b156dc573bd942a38731b0030cd5deab/users/92e907ff7fe24e0cae65a28802c6c472/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.414601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126c6ea-1d79-4dc8-b041-8d994133566c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.415615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b156dc573bd942a38731b0030cd5deab, user_id=92e907ff7fe24e0cae65a28802c6c472, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.418324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.424121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.425376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.425921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.426411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] PATH_INFO: `/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58/users/7bf9740d5dd742fd90f13dee8597ea3b/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.432494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2413f283b24b8caa94a0c5f9b58e58, user_id=7bf9740d5dd742fd90f13dee8597ea3b, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.436521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a05d8-b577-4da0-b49c-2dc45dd5a361 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.437853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 817/1631] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:12 2022] PUT /identity/v3/projects/b156dc573bd942a38731b0030cd5deab/users/92e907ff7fe24e0cae65a28802c6c472/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:12.438469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.485114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 815/1632] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:12 2022] PUT /identity/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58/users/7bf9740d5dd742fd90f13dee8597ea3b/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:12.485114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bcc3c-e724-4e73-8d03-04af604cc740 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.485114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bcc3c-e724-4e73-8d03-04af604cc740 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.485114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bcc3c-e724-4e73-8d03-04af604cc740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.571057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f16bcc3c-e724-4e73-8d03-04af604cc740 None None] MFA Rules not processed for user `92e907ff7fe24e0cae65a28802c6c472`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:12.571057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f16bcc3c-e724-4e73-8d03-04af604cc740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:12.571906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:12.620052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:12.621764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e812-4dcd-4216-9893-357305ebde80 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.727009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 816/1633] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:12.729067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.729424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.729776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.751231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.753103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.753306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.754062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.755140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.760496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.784594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 818/1634] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:12.787348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.802020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] MFA Rules not processed for user `7bf9740d5dd742fd90f13dee8597ea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:12.803283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:12.899513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a1f4e-e454-4826-b666-07461123beba admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:12.904709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:12.905626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:12.906114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:12.906747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:12.938695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:12.943467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:12.956376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 817/1635] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:12.959278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.970766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 819/1636] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:12.972234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:12.998016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb16b8-a050-470d-83da-cc015df52771 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:13.009602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d15ae-972b-4188-9683-e9432cc6487d service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:13.017649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:13.019471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:13.019928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:13.020373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] PATH_INFO: `/v3/projects/51fa5e97c2f7488896f260769d703ec1/users/82936c8f488945a0bedd04ff0e0ed1aa/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:13.023163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:13.023937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:13.024224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:13.024527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:13.033676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fa5e97c2f7488896f260769d703ec1, user_id=82936c8f488945a0bedd04ff0e0ed1aa, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:13.042310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:13.046633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:13.050758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeef1b-a796-4afb-b33b-0e4f82d77e2f service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:13.064520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 820/1637] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:13.090019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 818/1638] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:12 2022] PUT /identity/v3/projects/51fa5e97c2f7488896f260769d703ec1/users/82936c8f488945a0bedd04ff0e0ed1aa/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:13.096238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:13.096238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:13.096238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:13.180911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] MFA Rules not processed for user `82936c8f488945a0bedd04ff0e0ed1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:13.183432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:13.242620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:13.335892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:13.349665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 821/1639] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:13.367903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:13.369924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394ab10-1454-456a-bd7a-a575359d6ed6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:13.375502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:13.381406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:13.381752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:13.382025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:13.399418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a269330-23fe-4ce5-9f20-33632254f384 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:13.414204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:13.415227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:13.415700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:13.416011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:13.437163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:13.438786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:13.467087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 822/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:13.668403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:13.696881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:13.703704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6de169-d290-4e32-8474-f276519e98c5 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:13.726137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 819/1641] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:14.139593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:14.362914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7f3d-75f2-4c06-b7c7-9d47428b3980 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:14.382632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:14.383431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:14.383605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:14.383907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] PATH_INFO: `/v3/users/444e0c429cf240c98f584bd00afdf790` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:14.387344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=444e0c429cf240c98f584bd00afdf790)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:14.388396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: WARNING py.warnings [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:14.388396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: warnings.warn(msg) Sep 22 17:06:14.388396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: Sep 22 17:06:14.390040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:14.577404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444e0c429cf240c98f584bd00afdf790'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:14.594935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444e0c429cf240c98f584bd00afdf790'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:14.595929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444e0c429cf240c98f584bd00afdf790'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:14.601084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444e0c429cf240c98f584bd00afdf790'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:14.665061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444e0c429cf240c98f584bd00afdf790'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:14.799148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 823/1642] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:14 2022] DELETE /identity/v3/users/444e0c429cf240c98f584bd00afdf790 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:14.804207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:14.804737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:14.804737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:14.887463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:14.889067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:15.059681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 820/1643] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:15.124074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:15.126301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:15.239717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b60677-47a0-4610-8fe6-53098d89fc5f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:15.244274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:15.245085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:15.246006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:15.246381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:15.275387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:15.279379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:15.312651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 824/1644] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:15.961694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:15.964198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:15.996017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe21cfe-ec14-42ff-8d98-b5d18735867d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:16.028665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:16.029758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:16.030224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:16.030689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] PATH_INFO: `/v3/projects/c1e5e9e000ee4ae497b93981b39865e1` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:16.034001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e5e9e000ee4ae497b93981b39865e1)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:16.035306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: WARNING py.warnings [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 17:06:16.035306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: warnings.warn(msg) Sep 22 17:06:16.035306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: Sep 22 17:06:16.039755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:16.171334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e5e9e000ee4ae497b93981b39865e1', 'request_id': 'req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.191902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e5e9e000ee4ae497b93981b39865e1', 'request_id': 'req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.207558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e5e9e000ee4ae497b93981b39865e1', 'request_id': 'req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.248010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] The token cache is being invalidate because project c1e5e9e000ee4ae497b93981b39865e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:16.248304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.249971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.253889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 821/1645] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:15 2022] DELETE /identity/v3/projects/c1e5e9e000ee4ae497b93981b39865e1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:16.258947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:16.265718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:16.274559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1c32-e05c-4b79-b8e5-fd23e38a1777 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:16.446881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:16.450083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:16.452285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:16.452725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] PATH_INFO: `/v3/users/82936c8f488945a0bedd04ff0e0ed1aa` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:16.454698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82936c8f488945a0bedd04ff0e0ed1aa)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:16.460855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:16.610401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82936c8f488945a0bedd04ff0e0ed1aa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.621364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82936c8f488945a0bedd04ff0e0ed1aa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.622974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82936c8f488945a0bedd04ff0e0ed1aa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.624728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82936c8f488945a0bedd04ff0e0ed1aa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.644205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2c589f90-9f07-444c-92a5-fbb2544971b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82936c8f488945a0bedd04ff0e0ed1aa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:16.705069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 825/1646] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:16 2022] DELETE /identity/v3/users/82936c8f488945a0bedd04ff0e0ed1aa => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:16.837605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:16.839068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:16.859685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e9c7-1b79-4d0e-b712-6ed1843fd67b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:16.995347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:16.996077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:16.996375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:16.996652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] PATH_INFO: `/v3/users/8f16d27a3b564155aaa3b459daaea6cf` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:17.003779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f16d27a3b564155aaa3b459daaea6cf)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:17.005848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:17.014481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:17.097674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f16d27a3b564155aaa3b459daaea6cf'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:17.112527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f16d27a3b564155aaa3b459daaea6cf'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:17.113246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f16d27a3b564155aaa3b459daaea6cf'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:17.114029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f16d27a3b564155aaa3b459daaea6cf'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:17.127452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f16d27a3b564155aaa3b459daaea6cf'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:17.168266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 822/1647] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:16 2022] DELETE /identity/v3/users/8f16d27a3b564155aaa3b459daaea6cf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:17.170181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:17.170529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:17.170831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:17.193627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:17.195225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:17.287693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 826/1648] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:17.328347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:17.331088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:17.433894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f78a7-339e-4460-8e41-883a0b910a47 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:17.450816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:17.454552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:17.455039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:17.458537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:17.483075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:17.491634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434fd0a-7096-4c42-9db9-77c705844b07 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:17.523138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 823/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:18.875904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:18.878482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:18.898436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c155a53-37cd-43a9-9037-f1035dc36cf7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:18.904989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:18.905948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:18.906511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:18.907206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] PATH_INFO: `/v3/projects/51fa5e97c2f7488896f260769d703ec1` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:18.909477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fa5e97c2f7488896f260769d703ec1)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:18.912430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:18.967243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:19.043568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fa5e97c2f7488896f260769d703ec1', 'request_id': 'req-57e54ef2-ae0e-48e0-a596-746b377a4de3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:19.056805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fa5e97c2f7488896f260769d703ec1', 'request_id': 'req-57e54ef2-ae0e-48e0-a596-746b377a4de3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:19.071818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fa5e97c2f7488896f260769d703ec1', 'request_id': 'req-57e54ef2-ae0e-48e0-a596-746b377a4de3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:19.093470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] The token cache is being invalidate because project 51fa5e97c2f7488896f260769d703ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:19.094720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:19.096257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-57e54ef2-ae0e-48e0-a596-746b377a4de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:19.114415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 827/1650] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:18 2022] DELETE /identity/v3/projects/51fa5e97c2f7488896f260769d703ec1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:19.116190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:19.116722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:19.116819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:19.165365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:19.166637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:19.354205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 824/1651] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:19.365054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:19.365351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:19.365632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:19.426403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:19.427851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:19.449277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 828/1652] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:19.453888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:19.469330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c8988-aa44-4e7e-a334-f7ec39d24ccf None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:19.489352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:19.490004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:19.490358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:19.490590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:19.496543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:19.498536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:19.500307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:19.540643 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 825/1653] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:19.545044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:19.559635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfac05-eca6-41c5-98ef-5283eac766bc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:19.579588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:19.581520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:19.582006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:19.582387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:19.583379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:19.585561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:19.651063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:19.656236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 829/1654] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:19 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:19.666425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d1d4-3923-4897-ac1e-02ab74bad73f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:19.700939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:19.856939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:19.857671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:19.857962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:19.858242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:19.858981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:19.863715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:19.945027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 826/1655] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:19 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:19.951579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.007861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910adada-03ec-43b1-8045-6692f856d66f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:20.022620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:20.024378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:20.024877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:20.025504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:20.026443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:20.036186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:20.077990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 830/1656] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:20.078623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.081734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.084310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:20.094618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ca3b-c637-41df-a6cc-fd5fa2f90471 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:20.114746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:20.117229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:20.119234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:20.119540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:20.120312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:20.121947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:20.130332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231065-dd1b-42dd-ab67-b24e94e633e2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:20.136739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:20.137407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:20.137694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:20.137972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] PATH_INFO: `/v3/projects/e06a716f68c34a6d9e20c7b978008324` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:20.139251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06a716f68c34a6d9e20c7b978008324)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:20.141677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:20.179607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 827/1657] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:20.185806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.211731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251f893-1f00-4469-9e25-78c25acf0940 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:20.223595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:20.224621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:20.225674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:20.225956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] PATH_INFO: `/v3/projects/c0e2e5dd4e2f46ff92fce7cdc31f85d1/users/b78f052b07bd4746a046d512744eb614/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:20.249634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06a716f68c34a6d9e20c7b978008324', 'request_id': 'req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:20.266707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06a716f68c34a6d9e20c7b978008324', 'request_id': 'req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:20.269957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e2e5dd4e2f46ff92fce7cdc31f85d1, user_id=b78f052b07bd4746a046d512744eb614, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:20.283772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06a716f68c34a6d9e20c7b978008324', 'request_id': 'req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:20.297543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128fdc-533b-4494-9b03-daa648806544 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:20.333923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] The token cache is being invalidate because project e06a716f68c34a6d9e20c7b978008324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:20.335882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:20.339535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:20.349231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 828/1658] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:20 2022] PUT /identity/v3/projects/c0e2e5dd4e2f46ff92fce7cdc31f85d1/users/b78f052b07bd4746a046d512744eb614/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:20.351332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:20.351906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:20.352086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:20.356796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 831/1659] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:20 2022] DELETE /identity/v3/projects/e06a716f68c34a6d9e20c7b978008324 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:20.361693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.364480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:20.433319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] MFA Rules not processed for user `b78f052b07bd4746a046d512744eb614`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:20.435122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:20.648206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:20.718754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 829/1660] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:20.719820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:20.722410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b54bc-77d5-4f15-bd5b-8f2e928624ea admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:20.725181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:21.040757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:21.042081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:21.045432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:21.048787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] PATH_INFO: `/v3/users/7bf9740d5dd742fd90f13dee8597ea3b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:21.052500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf9740d5dd742fd90f13dee8597ea3b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:21.059119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:21.067300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5871-4ad7-41ff-883a-d55776ceba96 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:21.081989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:21.084426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:21.086607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:21.089706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:21.090922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:21.100634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:21.117440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:21.210243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 830/1661] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:20 2022] POST /identity/v3/projects => generated 363 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:21.214160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:21.261303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf9740d5dd742fd90f13dee8597ea3b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:21.284830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf9740d5dd742fd90f13dee8597ea3b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:21.285521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf9740d5dd742fd90f13dee8597ea3b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:21.286648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf9740d5dd742fd90f13dee8597ea3b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:21.304434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf9740d5dd742fd90f13dee8597ea3b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:21.377037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 832/1662] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:20 2022] DELETE /identity/v3/users/7bf9740d5dd742fd90f13dee8597ea3b => generated 0 bytes in 1016 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:21.440240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7da5-4b4e-4ba0-84e5-9d843acf1365 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:21.663933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:21.664576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:21.664864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:21.665166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:21.672493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:21.678414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:21.772632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:21.774158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:21.811559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 831/1663] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:21 2022] POST /identity/v3/users => generated 288 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:21.847956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ff29f-48dd-42c4-b64a-5f30c468f935 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:21.875497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:21.877978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:21.881204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:21.881766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:21.883775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:21.893636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:21.929299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 833/1664] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:21.933480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:21.948080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656713-5f1f-48ab-89f3-f6fd6330b5ba admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:21.961843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:21.962709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:21.963040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:21.965528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] PATH_INFO: `/v3/projects/71f98ec48b954e6498041915ebe9fd40/users/79fc72f86bc04d0492e18bcf2aae7518/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:22.006113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f98ec48b954e6498041915ebe9fd40, user_id=79fc72f86bc04d0492e18bcf2aae7518, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:22.012224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:22.077146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 832/1665] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:21 2022] PUT /identity/v3/projects/71f98ec48b954e6498041915ebe9fd40/users/79fc72f86bc04d0492e18bcf2aae7518/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:22.081802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:22.108643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf2e5-becd-4e33-a596-cfbb14b0fb32 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:22.321760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:22.322491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:22.322912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:22.323283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:22.326282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:22.328211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf09752-774e-4371-8e9b-c1a69727bdec admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:22.354818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 834/1666] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:22.359717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:22.377298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc5054-eaa5-419c-899b-e0a106dfd2b5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:22.391540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:22.392852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:22.393258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:22.393411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] PATH_INFO: `/v3/projects/71f98ec48b954e6498041915ebe9fd40/users/79fc72f86bc04d0492e18bcf2aae7518/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:22.405747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f98ec48b954e6498041915ebe9fd40, user_id=79fc72f86bc04d0492e18bcf2aae7518, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:22.409434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:22.435400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 833/1667] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:22 2022] PUT /identity/v3/projects/71f98ec48b954e6498041915ebe9fd40/users/79fc72f86bc04d0492e18bcf2aae7518/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:22.446128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:22.448857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:22.450526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:22.465047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:22.512663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] MFA Rules not processed for user `79fc72f86bc04d0492e18bcf2aae7518`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:22.514269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:22.691167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 835/1668] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:22.699982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:22.701883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:22.825987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:22.856975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb4a3-8484-49c7-a535-f1dffa441967 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:22.868778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:22.872993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:22.873385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:22.873848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:22.906941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:22.909645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:22.943374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 834/1669] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:23.036407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:23.037867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.100886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:23.102326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.124114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec1c7-9afd-4ef5-a82c-32176aad7af5 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:23.135773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:23.136400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.136679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.136950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:23.157345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.244357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd75805-be6f-4389-bd76-cb2c2d903a84 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:23.268541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:23.269215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.269497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.269861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] PATH_INFO: `/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:23.275499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2413f283b24b8caa94a0c5f9b58e58)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:23.277447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:23.362087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:23.363601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b441c-b0ad-4ecf-945b-6e6cf38d9064 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:23.399419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 835/1670] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:23.453189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2413f283b24b8caa94a0c5f9b58e58', 'request_id': 'req-8704fc17-0a0d-4b35-9f31-efbd60206bbc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:23.464751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2413f283b24b8caa94a0c5f9b58e58', 'request_id': 'req-8704fc17-0a0d-4b35-9f31-efbd60206bbc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:23.483538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2413f283b24b8caa94a0c5f9b58e58', 'request_id': 'req-8704fc17-0a0d-4b35-9f31-efbd60206bbc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:23.511893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] The token cache is being invalidate because project 9b2413f283b24b8caa94a0c5f9b58e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:23.512513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:23.519303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:23.526047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab4466-b51d-43cf-9528-340914bb33b0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.526344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab4466-b51d-43cf-9528-340914bb33b0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.526624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab4466-b51d-43cf-9528-340914bb33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:23.529329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 836/1671] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:23 2022] DELETE /identity/v3/projects/9b2413f283b24b8caa94a0c5f9b58e58 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:23.571833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fdab4466-b51d-43cf-9528-340914bb33b0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:23.573470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fdab4466-b51d-43cf-9528-340914bb33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.625487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:23.627608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.691173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:23.810836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 836/1672] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:23.812377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd453f-2bd0-43d6-a8f2-84813546ff24 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.812673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd453f-2bd0-43d6-a8f2-84813546ff24 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.812959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd453f-2bd0-43d6-a8f2-84813546ff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:23.877437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f8cd453f-2bd0-43d6-a8f2-84813546ff24 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:23.883567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704fc17-0a0d-4b35-9f31-efbd60206bbc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:23.885963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f8cd453f-2bd0-43d6-a8f2-84813546ff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:23.897180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:23.898631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.901425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.902458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] PATH_INFO: `/v3/users/2f55f3bbe4354815869346312fb1db60` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:23.909131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f55f3bbe4354815869346312fb1db60)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:23.911785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:23.918159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 837/1673] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:23.919563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:23.924003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:23.925393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.033385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f55f3bbe4354815869346312fb1db60'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:24.038229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] MFA Rules not processed for user `ebb6142f6a3f41e4af6f109b31dfc9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:24.039676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.056839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f55f3bbe4354815869346312fb1db60'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:24.057937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f55f3bbe4354815869346312fb1db60'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:24.060679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f55f3bbe4354815869346312fb1db60'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:24.077941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9bab64dc-5ccd-421a-b724-3d02105c1eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f55f3bbe4354815869346312fb1db60'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:24.155011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 838/1674] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:24.156190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:24.161134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.174782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 837/1675] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:23 2022] DELETE /identity/v3/users/2f55f3bbe4354815869346312fb1db60 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:24.179766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72328c-3ae0-4804-bfa6-c0ec6b86fdf3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.180777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72328c-3ae0-4804-bfa6-c0ec6b86fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.180777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72328c-3ae0-4804-bfa6-c0ec6b86fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.181712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b72ed-0b35-4d94-a93a-44524c5d5b3a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:24.187252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:24.250827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-aa72328c-3ae0-4804-bfa6-c0ec6b86fdf3 None None] MFA Rules not processed for user `ebb6142f6a3f41e4af6f109b31dfc9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:24.253114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-aa72328c-3ae0-4804-bfa6-c0ec6b86fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.351900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:24.353635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.353997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.355711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.359504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:24.360032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:24.366380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4bbe-1469-4553-8aef-d07a0a5ee6da admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:24.415211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 839/1676] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:24.433924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.433924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.433924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.436057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 838/1677] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:24.440641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.441017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.441419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.506212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:24.506300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.524334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 840/1678] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:24.529500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:24.530938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] MFA Rules not processed for user `ecffd903517544248689e4ad7a1846f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:24.539505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.588227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6e593-d3b2-4745-bf10-d5e73968dcf8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:24.624312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:24.635831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.639518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.642923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.644493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:24.655772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fd19b-1b03-4e15-ab0e-ce9b77cc153c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:24.736311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:24.781095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 841/1679] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:24 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:24.784456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.785103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.787209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:24.789677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 842/1680] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 17:06:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:24.792286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:24.798373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:24.864479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 839/1681] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:24.865434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:24.889308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a72d3-ea16-4a0f-8a74-cb9e7fa114da None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:24.972461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e570a6d-d4ec-421a-a213-d02686571989 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:24.980335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:24.980980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:24.981518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:24.981803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.035589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.037366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.037663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.037940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.040539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.044832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120993b3-8163-4b9e-b8b9-168f37acf82c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.113238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 840/1682] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:24 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:25.116374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.118682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.119234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.182388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.185201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2ef0-f3d0-41b1-af4c-03b98219a50a service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.208416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 843/1683] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:25.211502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a1be0-6e61-4871-bc53-d7c27c7859d8 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.211792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a1be0-6e61-4871-bc53-d7c27c7859d8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.212075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a1be0-6e61-4871-bc53-d7c27c7859d8 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.217774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 844/1684] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 17:06:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:25.224273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a1be0-6e61-4871-bc53-d7c27c7859d8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:25.239841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:25.250182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:25.266118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a1be0-6e61-4871-bc53-d7c27c7859d8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:25.278261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.280437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.280722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.281000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.281668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.284026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e85cb-089b-4c94-b756-33c2426a340a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.317892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 845/1685] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:25.319399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.319687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.321186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.371886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:25.373245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:25.402207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:25.452812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 841/1686] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:25.453849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:25.474908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc34d6d-3ae1-4077-905c-1292eb7b4bf3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:25.480075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.480941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.481638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.482226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.483584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.485033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.501046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 842/1687] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:25.502502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:25.531272 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7e41-5321-4cf3-a8b5-b4db48507c8d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:25.545868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.546728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.547375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.549270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.588472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 846/1688] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:25.589463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:25.604457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461d9f-3e9e-4cdb-aba7-da00bbd4a6f6 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:25.615557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.617543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.618478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.620073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] PATH_INFO: `/v3/projects/edbcf50afd434bee8f4cdc16c3c74cae/users/1b8597a857ea4507b88f5e23de28bdc9/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.644380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:25.679568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbcf50afd434bee8f4cdc16c3c74cae, user_id=1b8597a857ea4507b88f5e23de28bdc9, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.684206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.711472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 847/1689] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:25 2022] PUT /identity/v3/projects/edbcf50afd434bee8f4cdc16c3c74cae/users/1b8597a857ea4507b88f5e23de28bdc9/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:25.714164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:25.738445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:25.740130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d6bd6-d14b-4994-b7f5-eb460edfb7a5 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:25.766231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 843/1690] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:25.767934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.770991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.771307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:25.864731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] MFA Rules not processed for user `1b8597a857ea4507b88f5e23de28bdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:25.866191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:25.941326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d9610-8645-4806-b667-d59e27deeb7d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:25.973592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:25.974236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:25.974529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:25.974844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.117129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 844/1691] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:26.121492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:26.130541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:26.134493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da260ab7-92f2-40bd-8bb9-7ffa94631545 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:26.170622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 848/1692] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:26.349290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89138-2adf-4d5b-9ffb-06ef41de76bd None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:26.365160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:26.365792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.366529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.366529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.367016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:26.369245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd62a4c-c15f-4bf7-bf54-82e5282009db admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:26.461649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767249-40d9-40b3-ab36-7a37e8e25f2c None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.462623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767249-40d9-40b3-ab36-7a37e8e25f2c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.463117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd767249-40d9-40b3-ab36-7a37e8e25f2c None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.464980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 849/1693] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 22 17:06:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:06:26.471462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 845/1694] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:26 2022] POST /identity/v3/projects => generated 377 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:26.472387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd767249-40d9-40b3-ab36-7a37e8e25f2c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:26.481843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.482145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.483235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.512828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:26.518595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:26.523148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:26.630421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:26.638962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd767249-40d9-40b3-ab36-7a37e8e25f2c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:26.647367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:26.648536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.648536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.648704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.649309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:26.651283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7724e43-ff21-43e9-944d-f1de16cf886c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:26.698270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 850/1695] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:26 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:26.700015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.700441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.700853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.703436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 846/1696] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:06:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:26.705587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:26.732400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428cf61-cb5f-4437-a84d-03b16b982a22 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:26.744992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:26.745714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:26.746005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:26.746283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:26.747616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:26.750429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:26.772277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] MFA Rules not processed for user `0f915e1541084ef88223a405a0536ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:26.774143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:26.781338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 847/1697] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:26.785468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:26.793153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:27.001409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 851/1698] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:27.003260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.011789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f3a7b-7391-412b-9f4d-2114c3dc4c0a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.033948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.040415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.040516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.040790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.044458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04c33-854a-40ad-9184-3cf98a10159f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.076225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.077003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.077304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.077578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] PATH_INFO: `/v3/projects/c721bcb9462940af8ca56483c848d7ce/users/fa66693e4f244ce2afa378230d7182ad/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.099413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.101901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.133395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 848/1699] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:27.134177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.146186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c721bcb9462940af8ca56483c848d7ce, user_id=fa66693e4f244ce2afa378230d7182ad, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.159663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.162829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21395-63a0-4263-bba1-c0d1b0e9bed2 service glance] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.174726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.175421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.175695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.175980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.193597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.196171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.206430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 852/1700] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:27 2022] PUT /identity/v3/projects/c721bcb9462940af8ca56483c848d7ce/users/fa66693e4f244ce2afa378230d7182ad/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:27.220763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.232537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 849/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:27.333734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97daf8-1ef3-498d-bab9-1fcba2361666 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.340339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.341392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.341927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.342349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.348820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.350893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938faab3-9d15-428e-ae8f-60a82cdd7009 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.369550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 853/1702] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:27.373936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.405163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b533cc9-3ad4-4aef-a999-663c75724382 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.434455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.436162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.436455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.436733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] PATH_INFO: `/v3/projects/c721bcb9462940af8ca56483c848d7ce/users/fa66693e4f244ce2afa378230d7182ad/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.442328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c721bcb9462940af8ca56483c848d7ce, user_id=fa66693e4f244ce2afa378230d7182ad, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.453001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.499576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 850/1703] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:27 2022] PUT /identity/v3/projects/c721bcb9462940af8ca56483c848d7ce/users/fa66693e4f244ce2afa378230d7182ad/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:27.501318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.502106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.502572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.569720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:27.596770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] MFA Rules not processed for user `fa66693e4f244ce2afa378230d7182ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:27.598247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:27.648292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.650910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:27.793307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 854/1704] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:27.805529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:27.807125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:27.845392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44286cb4-a5ec-4ac4-9ead-7816f5491543 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.863851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.864776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.869030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.869496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] PATH_INFO: `/v3/users/b78f052b07bd4746a046d512744eb614` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:27.872438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78f052b07bd4746a046d512744eb614)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:27.878226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:27.950367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:27.982950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35911f95-17d7-4963-90b9-4c92ef529244 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:27.994849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:27.995753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:27.996239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:27.996558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:28.027602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78f052b07bd4746a046d512744eb614'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.049226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78f052b07bd4746a046d512744eb614'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.050094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78f052b07bd4746a046d512744eb614'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.050942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78f052b07bd4746a046d512744eb614'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.069641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f83d8361-b709-4a64-b1b1-545eda8b3385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78f052b07bd4746a046d512744eb614'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.114388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 851/1705] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:27 2022] DELETE /identity/v3/users/b78f052b07bd4746a046d512744eb614 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:28.118876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:28.119485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:28.119987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:28.167385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:28.171213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:28.178495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:28.180204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:28.196008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 855/1706] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:28.394217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 852/1707] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:28.404969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:28.410487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:28.430399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:28.432011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:28.464669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140465d-a1e2-4769-b7b1-e0f9d78be981 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:28.521385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:28.522207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:28.524958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:28.525275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] PATH_INFO: `/v3/projects/abb75c5f2c0741619a5b43d5d0a21b8b` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:28.528667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb75c5f2c0741619a5b43d5d0a21b8b)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:28.534988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:28.626626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48b2e4-c042-441a-8dbd-12a9dafcfc63 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:28.644450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:28.645271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:28.646025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:28.646340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:28.669956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:28.671631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:28.701511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 853/1708] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:28.733576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:28.753952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb75c5f2c0741619a5b43d5d0a21b8b', 'request_id': 'req-2cfa268d-7248-4f85-87c7-c5111c5a122e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.785445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb75c5f2c0741619a5b43d5d0a21b8b', 'request_id': 'req-2cfa268d-7248-4f85-87c7-c5111c5a122e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.809346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb75c5f2c0741619a5b43d5d0a21b8b', 'request_id': 'req-2cfa268d-7248-4f85-87c7-c5111c5a122e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.872628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] The token cache is being invalidate because project abb75c5f2c0741619a5b43d5d0a21b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:28.875975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.880766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2cfa268d-7248-4f85-87c7-c5111c5a122e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:28.889773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 856/1709] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:28 2022] DELETE /identity/v3/projects/abb75c5f2c0741619a5b43d5d0a21b8b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:28.894149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:28.896183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:28.926364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9adb-5d9c-4870-897f-dfc69784728b service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:29.069220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:29.120560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:29.121232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:29.121518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:29.121798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] PATH_INFO: `/v3/users/92e907ff7fe24e0cae65a28802c6c472` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:29.123492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e907ff7fe24e0cae65a28802c6c472)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:29.125490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:29.229774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73f9f-5417-4520-a018-7b54c82a462f None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:29.231594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73f9f-5417-4520-a018-7b54c82a462f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:29.232103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e73f9f-5417-4520-a018-7b54c82a462f None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:29.235347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 857/1710] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 22 17:06:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:29.244833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:29.245238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:29.245619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:29.296839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e907ff7fe24e0cae65a28802c6c472'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:29.312622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e907ff7fe24e0cae65a28802c6c472'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:29.314937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e907ff7fe24e0cae65a28802c6c472'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:29.317487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e907ff7fe24e0cae65a28802c6c472'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:29.348971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e907ff7fe24e0cae65a28802c6c472'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:29.409441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 854/1711] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:28 2022] DELETE /identity/v3/users/92e907ff7fe24e0cae65a28802c6c472 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:29.439965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:29.450286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:29.604551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 858/1712] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:06:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:29.672443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:29.674509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:29.699421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32a96a-25d9-4d24-b394-45cff88e5ed3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:29.719130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:29.719936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:29.720271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:29.720903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:29.745434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:29.747657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:29.779455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 855/1713] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:30.259185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:30.261186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:30.480750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf927bcf-686d-46e5-b7a5-68b373b9242a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:30.497060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:30.497933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:30.498513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:30.498950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:30.501725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:30.693889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:30.697258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81ad9-d5ee-46cf-b263-d1e049d04caa service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:30.729386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 859/1714] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:30.770000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:30.772996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:30.926768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0445b71-dfdb-43db-b663-9a80ab1d28a4 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:30.927374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0445b71-dfdb-43db-b663-9a80ab1d28a4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:30.927798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0445b71-dfdb-43db-b663-9a80ab1d28a4 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:30.929656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 860/1715] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 22 17:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:30.940627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:30.941158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:30.943063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:30.997665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:31.004131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.007729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4cfb2-6996-4478-a856-068905a26469 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:31.019936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:31.021237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:31.021674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:31.023404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] PATH_INFO: `/v3/projects/c0e2e5dd4e2f46ff92fce7cdc31f85d1` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:31.028657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e2e5dd4e2f46ff92fce7cdc31f85d1)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:31.034523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:31.040709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:31.193792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e2e5dd4e2f46ff92fce7cdc31f85d1', 'request_id': 'req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:31.198333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:31.217869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e2e5dd4e2f46ff92fce7cdc31f85d1', 'request_id': 'req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:31.229459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 861/1716] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:31.231895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:31.236697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.237506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e2e5dd4e2f46ff92fce7cdc31f85d1', 'request_id': 'req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:31.274080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] The token cache is being invalidate because project c0e2e5dd4e2f46ff92fce7cdc31f85d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:31.274522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:31.276952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:31.281029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 856/1717] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:30 2022] DELETE /identity/v3/projects/c0e2e5dd4e2f46ff92fce7cdc31f85d1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:31.285380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:31.288034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.431656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb4c-d993-481a-9a83-77a636bfb3e7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:31.435894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:31.436627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:31.437023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:31.442861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:31.445982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.459170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3aa0e-1541-4560-bc9b-e631ca7bc642 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:31.598029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:31.598701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:31.599503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:31.599802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:31.601748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.604818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:31.607578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:31.628517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 857/1718] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:31.630158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:31.638178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:31.640635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:31.645394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.674866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 862/1719] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:31.770280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:31.774923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:31.877425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c615c-e8ee-4efe-9ca8-e8842a0623c5 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:31.895825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:31.898946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:31.899237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:31.899841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] PATH_INFO: `/v3/users/79fc72f86bc04d0492e18bcf2aae7518` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:31.903070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fc72f86bc04d0492e18bcf2aae7518)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:31.905846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:31.913730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:31.961614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93745aa-74bd-471e-bade-7300c596a694 service placement] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:31.973585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:31.989687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:31.989963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:31.990242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] PATH_INFO: `/v3/projects/b156dc573bd942a38731b0030cd5deab` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:31.992346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b156dc573bd942a38731b0030cd5deab)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:31.994558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:32.022570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:32.087476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b156dc573bd942a38731b0030cd5deab', 'request_id': 'req-63e880a2-2e13-453d-bab1-213d52a90173'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.099095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b156dc573bd942a38731b0030cd5deab', 'request_id': 'req-63e880a2-2e13-453d-bab1-213d52a90173'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.117317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b156dc573bd942a38731b0030cd5deab', 'request_id': 'req-63e880a2-2e13-453d-bab1-213d52a90173'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.119207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fc72f86bc04d0492e18bcf2aae7518'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.133192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fc72f86bc04d0492e18bcf2aae7518'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.134176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fc72f86bc04d0492e18bcf2aae7518'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.135401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fc72f86bc04d0492e18bcf2aae7518'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.145143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] The token cache is being invalidate because project b156dc573bd942a38731b0030cd5deab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:32.145705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.147074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-63e880a2-2e13-453d-bab1-213d52a90173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.154696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 863/1720] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:31 2022] DELETE /identity/v3/projects/b156dc573bd942a38731b0030cd5deab => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:32.158242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a0b2-240e-4c52-9bfe-6372f829ada0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.159010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a0b2-240e-4c52-9bfe-6372f829ada0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.159472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3a0b2-240e-4c52-9bfe-6372f829ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.170935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0c69d4a9-ac47-44da-96cc-d9f047b82e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fc72f86bc04d0492e18bcf2aae7518'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:32.206137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-79d3a0b2-240e-4c52-9bfe-6372f829ada0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:32.207644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-79d3a0b2-240e-4c52-9bfe-6372f829ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:32.254180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 858/1721] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:31 2022] DELETE /identity/v3/users/79fc72f86bc04d0492e18bcf2aae7518 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:32.448679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 864/1722] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:32.455922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.458246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.458546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.508131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:32.510779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:32.525535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.525697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.525979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.597185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] MFA Rules not processed for user `ecffd903517544248689e4ad7a1846f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:32.600166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:32.854542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 859/1723] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:32.858960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:32.872440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18b7b9-50be-40a8-a74d-ca2694d953f7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:32.880521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:32.881273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.881654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.882147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.883096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:32.883521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:32.885295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d010fe8-1605-4a7b-9e1f-0adebbbc78cd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:32.923088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 860/1724] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:32.923653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 865/1725] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:32.924732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:32.943130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f89d-1233-42b4-add3-d74ec08f3950 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.944795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f89d-1233-42b4-add3-d74ec08f3950 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.946165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f89d-1233-42b4-add3-d74ec08f3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.957312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dff5db-c108-4f8b-8baa-e349359daaa3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:32.980256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:32.980903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:32.981191 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:32.981470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:32.982127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:32.984105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:33.026621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2944f89d-1233-42b4-add3-d74ec08f3950 None None] MFA Rules not processed for user `071a117b156f46b0b3afb5c47b3baef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:33.032250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2944f89d-1233-42b4-add3-d74ec08f3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:33.049914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:33.093006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 866/1726] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:32 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:33.106875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:33.364215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 861/1727] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:33.377075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.379586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.380090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.380691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da29f5-a270-48de-9d29-35260b4a0ba1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:33.395868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:33.396927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.397408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.400068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.400805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:33.409259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:33.438681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] MFA Rules not processed for user `071a117b156f46b0b3afb5c47b3baef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:33.441863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:33.457718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 867/1728] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:33 2022] POST /identity/v3/users => generated 284 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:33.459593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:33.472422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:33.491436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a81b4-9c67-4193-99e0-db7ad046e5c0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:33.504275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:33.504783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.509055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.518514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.520029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:33.538348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413adb-ccb0-4a00-b1fa-7b69e1db1b8d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:33.572294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 868/1729] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:33.573113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.574918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.576209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.605336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 862/1730] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:33.609262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:33.616632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] MFA Rules not processed for user `0f915e1541084ef88223a405a0536ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:33.618020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:33.640257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d4dac-41ee-431d-a2b1-b8f0db928499 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:33.668625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:33.669673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.670056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.670337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.676821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:33.678669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:33.720718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 863/1731] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:33.722363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:33.725373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:33.752448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 869/1732] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:33.753961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:33.783368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf0ed5-e033-4665-9d94-5554fe404b0a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:33.800934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:33.801754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.804147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.804556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] PATH_INFO: `/v3/projects/009eba01702b4be095813b5b8b31040e/users/d3ae4ef9092345a69e35dfcad0da49bf/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.854933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=009eba01702b4be095813b5b8b31040e, user_id=d3ae4ef9092345a69e35dfcad0da49bf, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:33.862577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe44ee-634a-4fa9-9e5e-863f888854ad admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:33.903832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 870/1733] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:33 2022] PUT /identity/v3/projects/009eba01702b4be095813b5b8b31040e/users/d3ae4ef9092345a69e35dfcad0da49bf/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:33.918019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:33.918590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:33.919259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:33.955183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc672d-1cc2-479a-bdb8-3d2262bb748c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:33.960206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] MFA Rules not processed for user `d3ae4ef9092345a69e35dfcad0da49bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:33.961790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:34.058357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:34.112964 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 871/1734] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:34.118062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:34.154173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.155135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.155639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.156112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.249170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a55e52-42db-406c-9890-031a78b64e60 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:34.260027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.261372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.261888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.262361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.263389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.267285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.312715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:34.330870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 872/1735] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:34 2022] POST /identity/v3/projects => generated 367 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:34.333098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:34.350314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:34.350695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.352456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.377716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 864/1736] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:34.378289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:34.396579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37fcf5-c7af-459d-bcd6-6995568742a8 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:34.599967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.600848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.601139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.601419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.605818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.607857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.639802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ee18-e6e5-44e8-a7c4-3c9e43606ed9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:34.660595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 865/1737] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:34 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:34.664964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:34.668658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.669767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.670294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.670768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] PATH_INFO: `/v3/projects/71f98ec48b954e6498041915ebe9fd40` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.675645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f98ec48b954e6498041915ebe9fd40)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.680332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.689565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab97bad-ea9e-42d1-83bd-f8a3762770df admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:34.703995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.704741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.705026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.705301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.706021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.707754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.730172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 866/1738] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:34.736898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:34.777218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f792a2d-aa2f-4684-bde1-df4fd4b13ebb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:34.804118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f98ec48b954e6498041915ebe9fd40', 'request_id': 'req-efd38ec1-de3e-49e6-87b6-417d4effbb77'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:34.815373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f98ec48b954e6498041915ebe9fd40', 'request_id': 'req-efd38ec1-de3e-49e6-87b6-417d4effbb77'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:34.828644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f98ec48b954e6498041915ebe9fd40', 'request_id': 'req-efd38ec1-de3e-49e6-87b6-417d4effbb77'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:34.841185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:34.853347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] The token cache is being invalidate because project 71f98ec48b954e6498041915ebe9fd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:34.854093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:34.856933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efd38ec1-de3e-49e6-87b6-417d4effbb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:34.861833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 873/1739] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:34 2022] DELETE /identity/v3/projects/71f98ec48b954e6498041915ebe9fd40 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:34.866699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fce1-3503-4bcb-99f5-d4a50b6e3785 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.867146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fce1-3503-4bcb-99f5-d4a50b6e3785 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.867573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093fce1-3503-4bcb-99f5-d4a50b6e3785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.913421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:34.914451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e093fce1-3503-4bcb-99f5-d4a50b6e3785 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:34.914752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.915234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.915736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] PATH_INFO: `/v3/projects/c1332010b2f342e596e42f5ed0cf4c54/users/24122e0ee6f5420fb139671d43bf1847/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.917333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e093fce1-3503-4bcb-99f5-d4a50b6e3785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:34.943372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1332010b2f342e596e42f5ed0cf4c54, user_id=24122e0ee6f5420fb139671d43bf1847, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:34.949684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:34.952869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 874/1740] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:34.955091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:34.955388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:34.955673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:34.988493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:34.989620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:34.993918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 867/1741] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:34 2022] PUT /identity/v3/projects/c1332010b2f342e596e42f5ed0cf4c54/users/24122e0ee6f5420fb139671d43bf1847/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:34.999313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.006486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:35.101087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 875/1742] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:35.125440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.150409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d6cc-bb83-4cc3-9f82-78ba5b17264d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.170302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.171455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.173907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.175413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.179290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:35.180108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:35.184043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:35.190558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:35.228462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 876/1743] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:06:35.231010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.231676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ae2e4-6afa-4b94-8b06-e4556e85acc9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.247525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.248189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.249386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.249665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.250343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:35.256338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:35.277657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b849916-465d-4849-b8a4-c4d39c6d984d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.290242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 868/1744] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:35.294963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.298856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.302371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.303537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.304074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.306188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:35.312817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b49b9-af3c-45da-b17e-6396fa38bba4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:35.329798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f3c3-5024-48e1-9f25-df0c64cccdf3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.351012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.357856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.359102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.359410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] PATH_INFO: `/v3/projects/c1332010b2f342e596e42f5ed0cf4c54/users/24122e0ee6f5420fb139671d43bf1847/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.364977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1332010b2f342e596e42f5ed0cf4c54, user_id=24122e0ee6f5420fb139671d43bf1847, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:35.369969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:35.396745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 877/1745] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:35 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:35.402582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ed22-29f6-4453-b545-4b6409c3e989 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.402886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ed22-29f6-4453-b545-4b6409c3e989 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.403165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ed22-29f6-4453-b545-4b6409c3e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.415467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 869/1746] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:35 2022] PUT /identity/v3/projects/c1332010b2f342e596e42f5ed0cf4c54/users/24122e0ee6f5420fb139671d43bf1847/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:35.416809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.483944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0895ed22-29f6-4453-b545-4b6409c3e989 None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:35.487554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0895ed22-29f6-4453-b545-4b6409c3e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:35.662542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 878/1747] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:06:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:35.662929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f761-c477-442b-8fd6-1f0f24c16a13 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.664050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d8e4-c716-4660-a17c-c84eca0473e9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.664969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d8e4-c716-4660-a17c-c84eca0473e9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.665353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d8e4-c716-4660-a17c-c84eca0473e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.709595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-1432d8e4-c716-4660-a17c-c84eca0473e9 None None] MFA Rules not processed for user `24122e0ee6f5420fb139671d43bf1847`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:35.711313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1432d8e4-c716-4660-a17c-c84eca0473e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:35.823066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.823709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.823993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.824270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.831367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:35.833814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:35.893779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:35.916372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 870/1748] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:35 2022] POST /identity/v3/users => generated 290 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:35.919621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:35.921193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 879/1749] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:35.923842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.924551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.924940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:35.927733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:35.967802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082ecd-4633-4f8c-b872-df09ba5a2d5a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:35.989617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:35.991774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:35.991903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:35.994763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.013403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:36.015777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:36.046317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 871/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:36.047694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:36.051536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.074879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:36.079577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.085090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62a9e-b326-4541-b042-653f769c5469 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:36.100006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:36.102348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:36.103260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:36.104123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] PATH_INFO: `/v3/users/1b8597a857ea4507b88f5e23de28bdc9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.106767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8597a857ea4507b88f5e23de28bdc9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:36.114134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:36.242930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8597a857ea4507b88f5e23de28bdc9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:36.247001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:36.260570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8597a857ea4507b88f5e23de28bdc9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:36.261400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8597a857ea4507b88f5e23de28bdc9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:36.262380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8597a857ea4507b88f5e23de28bdc9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:36.272833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8597a857ea4507b88f5e23de28bdc9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:36.299026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 872/1751] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:36 2022] DELETE /identity/v3/users/1b8597a857ea4507b88f5e23de28bdc9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:36.300558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:36.304483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.304968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 880/1752] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:06:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:36.307944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:36.312891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.495830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62213c75-6dea-4353-9dff-26b856b46cea None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:36.549064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a240c6-0ffd-452d-b6c0-258acf653b0d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:36.566585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:36.567562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:36.569308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:36.571291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.576607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:36.579894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bde7c1-2aa7-4ee1-97c5-3f86cb334728 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:36.611968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:36.611968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:36.611968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:36.612380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.616807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.658409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 873/1753] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:36.658932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:36.659636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:36.659924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.706332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:36.723257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] MFA Rules not processed for user `071e49ba214a4ff1be50157f514fc2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:36.724699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.771345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:36.773578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0497f-5467-4a07-bd2d-24ea8904312f service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:36.801020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 881/1754] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:36.819388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:36.821511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:36.821828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:36.892273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:36.893810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:36.906117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 882/1755] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:36.910110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:36.916734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:37.038695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 874/1756] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:37.039778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:37.055034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511086db-3723-40c9-b23b-64c9747d27ea None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:37.060121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:37.060943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:37.061145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:37.061422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:37.062084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:37.064876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:37.117123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 875/1757] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:37.118342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:37.123785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:37.153294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979a1c5-e915-4fac-b448-52cdff9d5575 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:37.172001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:37.173781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:37.176043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:37.177278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:37.181824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:37.284282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efbc27-0231-428d-bea3-6d9e9f921a41 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:37.300636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:37.301331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:37.301610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:37.301881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:37.318018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:37.320191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:37.391169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:37.394789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:37.448187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 876/1758] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:37.449321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:37.498827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fffb1c-7502-4bb0-a9f7-4c5e7d5d950a service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:37.515913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:37.518461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:37.518841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:37.523992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] PATH_INFO: `/v3/projects/02340877726543c487d43e9d5134704f/users/1900af343bbc461e9b1d1d7ff18ddff3/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:37.529802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:37.531558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:37.552132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 883/1759] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:06:37.555608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:37.569568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:37.575226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02340877726543c487d43e9d5134704f, user_id=1900af343bbc461e9b1d1d7ff18ddff3, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:37.586721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8beea4-ac05-4458-8b1a-4b1b349ba63f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:37.660549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 877/1760] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:37 2022] PUT /identity/v3/projects/02340877726543c487d43e9d5134704f/users/1900af343bbc461e9b1d1d7ff18ddff3/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:37.671029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:37.671570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:37.671993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:37.828339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:37.849434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7fdef-0992-401b-a235-5be380c494a6 service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:37.880804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] MFA Rules not processed for user `1900af343bbc461e9b1d1d7ff18ddff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:37.882131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:38.116624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:38.120345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:38.122126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:38.124641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:38.237122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 878/1761] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:38.252416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:38.310571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:38.322481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25e962-c2cf-45ba-8d95-b67a55f83ff8 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:38.374919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 884/1762] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:38.675267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:38.675672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:38.675791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:38.758412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:38.764634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:38.803480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e0318-02c9-4fc0-8658-31871cdafca3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:38.809389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 885/1763] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 22 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:38.823340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:38.826375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:38.841720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:38.844889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:38.845184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:38.845469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:38.857392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:38.885212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:38.917107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc301ad-32fa-4ecc-addf-27b32641684d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:38.945716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:38.955447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:38.957594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:38.958029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:38.992825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:39.000130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:39.033013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 886/1764] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:39.045586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.045767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 879/1765] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:38 2022] POST /identity/v3/projects => generated 379 bytes in 794 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:39.077799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c0e2f-c629-4d51-884d-194cf75607e9 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:39.291436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:39.292480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:39.292911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:39.293360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:39.294144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:39.299150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:39.333150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 887/1766] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:39 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:39.338477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.357043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.357987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aac18-8618-432b-ac2e-73da41c1c030 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:39.358936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:39.371261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:39.372001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:39.372406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:39.372796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:39.373714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:39.380352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:39.410443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 880/1767] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:39.411603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.440852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0252e-d2f1-4734-ac94-c279885d529e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:39.466837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:39.469556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:39.471840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:39.473207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] PATH_INFO: `/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7/users/26d7e34e85274ee6a28c3b0b80bb4bdf/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:39.507018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:39.535305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b0d21c8a294e348a797ff6c8e41ad7, user_id=26d7e34e85274ee6a28c3b0b80bb4bdf, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:39.538484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:39.550837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:39.604763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 881/1768] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:39 2022] PUT /identity/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7/users/26d7e34e85274ee6a28c3b0b80bb4bdf/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:39.609009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.761227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb426f4-2045-4b01-8f5e-5a482267152a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:39.841044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b17bf-42b2-4012-985d-de385abb3bda admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:39.855636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:39.857275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:39.857566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:39.857885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:39.862894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:39.892034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:39.969230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 882/1769] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:39.971227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:39.972941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:39.974870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:39.978723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:39.978723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:40.034052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73ef7-9d7a-4bb6-bfd1-f2c9d4ffaab5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:40.072530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:40.077379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:40.077842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:40.079485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] PATH_INFO: `/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7/users/26d7e34e85274ee6a28c3b0b80bb4bdf/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:40.129303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b0d21c8a294e348a797ff6c8e41ad7, user_id=26d7e34e85274ee6a28c3b0b80bb4bdf, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:40.143728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c644-2dd6-402e-b8ed-42735c1a4f67 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:40.218340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 883/1770] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:39 2022] PUT /identity/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7/users/26d7e34e85274ee6a28c3b0b80bb4bdf/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:40.235894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:40.241064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:40.241357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:40.265524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:40.279917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9be42-e243-4635-8f34-718fdd45ebea service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:40.330339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 888/1771] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 974 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:40.334243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:40.334896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:40.340114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:40.374775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] MFA Rules not processed for user `071a117b156f46b0b3afb5c47b3baef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:40.381412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:40.453340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] MFA Rules not processed for user `26d7e34e85274ee6a28c3b0b80bb4bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:40.456357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:40.675698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:40.736607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 884/1772] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:40.738411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:40.749921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:40.875039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 889/1773] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:40.886085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:41.073866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d09b2f-1827-4aaa-a7c0-04ae4027f06f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:41.081259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:41.082286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:41.082787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:41.083416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] PATH_INFO: `/v3/projects/edbcf50afd434bee8f4cdc16c3c74cae` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:41.085309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbcf50afd434bee8f4cdc16c3c74cae)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:41.087893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:41.103796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb527a4-81b9-4fc7-9387-ec4ed72fe1c8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:41.117704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:41.118223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:41.118514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:41.118825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:41.152572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:41.156105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:41.189008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 890/1774] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:41.197213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:41.257915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbcf50afd434bee8f4cdc16c3c74cae', 'request_id': 'req-038cb364-7f12-49d0-9c3b-33ca98dcd43b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.275426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbcf50afd434bee8f4cdc16c3c74cae', 'request_id': 'req-038cb364-7f12-49d0-9c3b-33ca98dcd43b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.295901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbcf50afd434bee8f4cdc16c3c74cae', 'request_id': 'req-038cb364-7f12-49d0-9c3b-33ca98dcd43b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.325034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] The token cache is being invalidate because project edbcf50afd434bee8f4cdc16c3c74cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:41.325496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.326372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.328448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 885/1775] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:40 2022] DELETE /identity/v3/projects/edbcf50afd434bee8f4cdc16c3c74cae => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:41.341579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:41.366104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5ddc9-5132-4aa6-a679-d4c1d80ac2e3 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:41.612142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:41.613672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:41.613963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:41.614250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] PATH_INFO: `/v3/users/fa66693e4f244ce2afa378230d7182ad` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:41.616742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa66693e4f244ce2afa378230d7182ad)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:41.618741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:41.807600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa66693e4f244ce2afa378230d7182ad'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.829565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa66693e4f244ce2afa378230d7182ad'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.831072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa66693e4f244ce2afa378230d7182ad'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.834140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa66693e4f244ce2afa378230d7182ad'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.863376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa66693e4f244ce2afa378230d7182ad'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:41.941319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 891/1776] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:41 2022] DELETE /identity/v3/users/fa66693e4f244ce2afa378230d7182ad => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:42.319242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:42.321367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:42.621896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cb364-7f12-49d0-9c3b-33ca98dcd43b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:42.933921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d7e34e85274ee6a28c3b0b80bb4bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:42.934615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:42.934938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:42.935226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:42.942603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:42.943005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:42.948325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:42.992174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 886/1777] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 674 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:42.995765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:42.997233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:43.017765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:43.037319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e8b3f-51af-498c-bf94-ec30bc3824cb admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:43.061722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d7e34e85274ee6a28c3b0b80bb4bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:43.066497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:43.066806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:43.068633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:43.076556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:43.095126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:43.206942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 892/1778] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:42 2022] POST /identity/v3/projects => generated 354 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:43.210605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:43.228708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ffaa-aa6c-4a83-9e1a-02cd94e13c6e tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:43.474075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:43.536109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d7e34e85274ee6a28c3b0b80bb4bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:43.537010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:43.537665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:43.542916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:43.546381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:43.548758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:43.551237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5982c1-651c-4d21-a21f-f14901bd2d88 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:43.647442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 887/1779] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:43.720571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:43.737294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3144914-1317-4112-b64d-8b3634fdf42a tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:43.764464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d7e34e85274ee6a28c3b0b80bb4bdf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:43.766726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:43.767466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:43.767971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] PATH_INFO: `/v3/projects/7108213a3315471d8f4c662393714b7f` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:43.772820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7108213a3315471d8f4c662393714b7f)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:43.788857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:43.825716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:43.826100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:43.826687 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:43.829247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 888/1780] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:06:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:44.009966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7108213a3315471d8f4c662393714b7f', 'request_id': 'req-defc8d13-b19e-4119-a5cb-8b20f1a47a96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.021293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:44.023433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:44.049550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7108213a3315471d8f4c662393714b7f', 'request_id': 'req-defc8d13-b19e-4119-a5cb-8b20f1a47a96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.064207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7108213a3315471d8f4c662393714b7f', 'request_id': 'req-defc8d13-b19e-4119-a5cb-8b20f1a47a96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.084980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] The token cache is being invalidate because project 7108213a3315471d8f4c662393714b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:44.085659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.086920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-defc8d13-b19e-4119-a5cb-8b20f1a47a96 tempest-VolumeQuotaClassesTest-933316843 tempest-VolumeQuotaClassesTest-933316843-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.100390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 893/1781] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:43 2022] DELETE /identity/v3/projects/7108213a3315471d8f4c662393714b7f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:44.129180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e014f8-a196-4b46-9a8f-9431463628bb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:44.130137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e014f8-a196-4b46-9a8f-9431463628bb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:44.130640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e014f8-a196-4b46-9a8f-9431463628bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:44.189481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-77e014f8-a196-4b46-9a8f-9431463628bb None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:44.195576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-77e014f8-a196-4b46-9a8f-9431463628bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:44.241339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3624d4-c810-4dee-992a-118e2ced9367 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:44.252968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:44.254199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:44.269001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:44.269535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] PATH_INFO: `/v3/users/d3ae4ef9092345a69e35dfcad0da49bf` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:44.272157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ae4ef9092345a69e35dfcad0da49bf)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:44.275604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:44.398850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ae4ef9092345a69e35dfcad0da49bf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.428914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ae4ef9092345a69e35dfcad0da49bf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.430837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ae4ef9092345a69e35dfcad0da49bf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.432314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ae4ef9092345a69e35dfcad0da49bf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.481890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ae4ef9092345a69e35dfcad0da49bf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:44.519752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 894/1782] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:06:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:44.538130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 889/1783] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:44 2022] DELETE /identity/v3/users/d3ae4ef9092345a69e35dfcad0da49bf => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:44.542642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:44.543161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:44.543595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:44.582538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:44.585317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:44.664875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:44.667064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:44.728188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:44.754027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 895/1784] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:44.821554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:44.823604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:44.861129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc5b2-78d2-4c69-8cfb-3873e81c4515 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:44.872128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:44.874855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:44.875813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:44.876780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] PATH_INFO: `/v3/users/1900af343bbc461e9b1d1d7ff18ddff3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:44.883482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1900af343bbc461e9b1d1d7ff18ddff3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:44.887889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:44.910338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:44.960038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a3b4e-161b-41af-934e-5478f8e77f01 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:44.970597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:44.971474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:44.971823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:44.991525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:45.017107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:45.019938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d01bf-11dc-4c27-a01e-efa5aa648c0e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:45.030597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1900af343bbc461e9b1d1d7ff18ddff3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:45.047163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1900af343bbc461e9b1d1d7ff18ddff3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:45.052149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1900af343bbc461e9b1d1d7ff18ddff3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:45.052848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1900af343bbc461e9b1d1d7ff18ddff3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:45.055080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 896/1785] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:45.062482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1900af343bbc461e9b1d1d7ff18ddff3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:45.095093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 890/1786] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:44 2022] DELETE /identity/v3/users/1900af343bbc461e9b1d1d7ff18ddff3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:45.099816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:45.100322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:45.100787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:45.153645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:45.154977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:45.387904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 897/1787] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:45.441836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:45.443648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:45.653319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712218f5-63de-49b7-8017-17198a2a5928 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:45.671141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:45.672170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:45.675588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:45.676019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:45.720495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:45.722241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:45.753383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 891/1788] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:45.857478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:45.859815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:46.215664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d11db0-172c-41d6-9670-0167b657fb71 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:46.235947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:46.236590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:46.236876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:46.237202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:46.240668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:46.273412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:46.275824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942deecd-c56d-4aa7-82c0-9b2a2359e797 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:46.293057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 898/1789] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:46.900722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:46.902285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:46.962078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac40a8-0070-4233-b70c-d5f6a0009223 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:47.014441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:47.015442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.016902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.017471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] PATH_INFO: `/v3/projects/c721bcb9462940af8ca56483c848d7ce` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.019971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c721bcb9462940af8ca56483c848d7ce)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:47.023068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:47.195724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c721bcb9462940af8ca56483c848d7ce', 'request_id': 'req-191880d0-5d50-472a-b08c-df4b87a52e93'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:47.214711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c721bcb9462940af8ca56483c848d7ce', 'request_id': 'req-191880d0-5d50-472a-b08c-df4b87a52e93'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:47.231954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c721bcb9462940af8ca56483c848d7ce', 'request_id': 'req-191880d0-5d50-472a-b08c-df4b87a52e93'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:47.269639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] The token cache is being invalidate because project c721bcb9462940af8ca56483c848d7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:47.269937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:47.270919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-191880d0-5d50-472a-b08c-df4b87a52e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:47.276638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 892/1790] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:46 2022] DELETE /identity/v3/projects/c721bcb9462940af8ca56483c848d7ce => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:47.279958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.280632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.280902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.317511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:47.319138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:47.347929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:47.451680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 899/1791] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:47.457542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.457851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.458182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.536023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:47.537680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:47.563690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 893/1792] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:47.568250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:47.581346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651b7a-3fe0-4bc7-a461-66d9b57aa041 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:47.588164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:47.589481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.590068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.590704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.591962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:47.592741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:47.595762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:47.636487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 900/1793] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:47.641980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:47.649633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:47.655876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e993f8-b722-472b-9615-03b7b9d6eda2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:47.675862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:47.678789 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.679228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.680334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.683393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:47.686315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:47.783685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:47.786338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 894/1794] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:47 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:47.798442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41f3c4-78ad-479b-a226-a509c444f696 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:47.984395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:47.985187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:47.985575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:47.985978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:47.986745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:47.991880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:48.032838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 901/1795] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:47 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:48.033188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:48.048850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d05d2d-5ba3-46ac-bab6-e3052ffac2c2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:48.061055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:48.062914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:48.063410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:48.066988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:48.067873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:48.069710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:48.100325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 895/1796] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:48.104243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:48.120912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40288b-3eae-4af0-ada3-705a73c16fed admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:48.133479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:48.134118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:48.134400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:48.134712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:48.135439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:48.137272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c59c5-3d9c-4dba-9aff-07e7aa7a7ba5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:48.170774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 902/1797] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:48.171826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:48.193917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9684d08-e7e4-4d78-b52d-aeeb0e351328 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:48.204639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:48.205336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:48.205610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:48.205948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] PATH_INFO: `/v3/projects/45b2f1211df446bfaa49860f32146646/users/08a658053ee34a0dbf6135de0d409b80/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:48.251436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b2f1211df446bfaa49860f32146646, user_id=08a658053ee34a0dbf6135de0d409b80, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:48.255024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:48.303439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:48.303988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:48.303988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:48.307245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 896/1798] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:48 2022] PUT /identity/v3/projects/45b2f1211df446bfaa49860f32146646/users/08a658053ee34a0dbf6135de0d409b80/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:48.354357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] MFA Rules not processed for user `08a658053ee34a0dbf6135de0d409b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:48.355820 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:48.572911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 903/1799] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:48.573085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:48.762983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0b91-bfb4-441c-83e3-415e3ae04758 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:48.772100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:48.773239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:48.773922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:48.774362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:48.776295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:48.779980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:48.894959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 897/1800] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:48 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:48.899215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:48.921615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd20f-0541-402d-b0df-320f1b6091f8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:49.014975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:49.118807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:49.119435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.120062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.120347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.120988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:49.122969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:49.153635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 904/1801] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:48 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:49.161306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:49.197394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb83e3-9378-48a9-9844-028b8437fd9d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:49.217526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:49.218407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.219133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.219729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.220621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:49.222398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:49.237322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:49.242347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:49.244907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 898/1802] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:49.248487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:49.280289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d145-494e-48c4-9bb2-dc96a2157ca2 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:49.313316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b75b3c-a147-43cd-a881-26212c3f0deb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:49.326968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:49.331688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.331997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.333390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] PATH_INFO: `/v3/projects/009eba01702b4be095813b5b8b31040e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.334273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:49.336852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.337699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=009eba01702b4be095813b5b8b31040e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:49.338221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.338506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.342821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:49.343625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:49.347595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:49.389055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 899/1803] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:49.403766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:49.431996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262ca2c-dcde-415a-b61e-a60b17f6f3a3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:49.449249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:49.462118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.462416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.462724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] PATH_INFO: `/v3/projects/2f356ccde8154b31a017627a574bf11e/users/964222ea13274318bbb7aadd0587ee0e/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.548564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f356ccde8154b31a017627a574bf11e, user_id=964222ea13274318bbb7aadd0587ee0e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:49.551985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833b7a-304b-4d7c-af03-276a7dc4a7d0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:49.581830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009eba01702b4be095813b5b8b31040e', 'request_id': 'req-69dd0a41-368e-4c84-ba98-e560f3730dce'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:49.609640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009eba01702b4be095813b5b8b31040e', 'request_id': 'req-69dd0a41-368e-4c84-ba98-e560f3730dce'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:49.626711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 900/1804] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:49 2022] PUT /identity/v3/projects/2f356ccde8154b31a017627a574bf11e/users/964222ea13274318bbb7aadd0587ee0e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:49.638153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:49.639143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:49.639258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009eba01702b4be095813b5b8b31040e', 'request_id': 'req-69dd0a41-368e-4c84-ba98-e560f3730dce'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:49.641936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:49.673561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] The token cache is being invalidate because project 009eba01702b4be095813b5b8b31040e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:49.673862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:49.679328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:49.685155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 905/1805] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:49 2022] DELETE /identity/v3/projects/009eba01702b4be095813b5b8b31040e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:49.686343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:49.688361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:49.726759 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] MFA Rules not processed for user `964222ea13274318bbb7aadd0587ee0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:49.729691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:49.833632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:49.923623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0a41-368e-4c84-ba98-e560f3730dce admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:50.014011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:50.018433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 901/1806] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:50.021421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:50.026643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:50.058146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:50.059463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:50.059463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:50.059851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] PATH_INFO: `/v3/users/24122e0ee6f5420fb139671d43bf1847` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:50.063050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24122e0ee6f5420fb139671d43bf1847)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:50.065440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:50.184318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24122e0ee6f5420fb139671d43bf1847'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.195003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24122e0ee6f5420fb139671d43bf1847'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.196082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24122e0ee6f5420fb139671d43bf1847'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.196926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24122e0ee6f5420fb139671d43bf1847'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.212864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24122e0ee6f5420fb139671d43bf1847'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.228221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b095cf-6953-4fe4-a9b7-d75fab63de54 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:50.244913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:50.246368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:50.246864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:50.249181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] PATH_INFO: `/v3/projects/02340877726543c487d43e9d5134704f` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:50.254072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02340877726543c487d43e9d5134704f)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:50.257404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:50.272310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 906/1807] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:49 2022] DELETE /identity/v3/users/24122e0ee6f5420fb139671d43bf1847 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:50.272310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:50.273878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:50.388468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02340877726543c487d43e9d5134704f', 'request_id': 'req-92324cdb-f048-48eb-bfe6-b99f47995564'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.409741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02340877726543c487d43e9d5134704f', 'request_id': 'req-92324cdb-f048-48eb-bfe6-b99f47995564'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.422967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02340877726543c487d43e9d5134704f', 'request_id': 'req-92324cdb-f048-48eb-bfe6-b99f47995564'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.448751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] The token cache is being invalidate because project 02340877726543c487d43e9d5134704f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:50.448955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.451484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.454165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 902/1808] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:50 2022] DELETE /identity/v3/projects/02340877726543c487d43e9d5134704f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:50.464495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:50.466185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:50.504849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6561fb-4982-476c-a792-8dc03cf81db5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:50.637427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92324cdb-f048-48eb-bfe6-b99f47995564 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:50.650549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:50.652470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:50.652965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:50.654120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] PATH_INFO: `/v3/users/26d7e34e85274ee6a28c3b0b80bb4bdf` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:50.658503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d7e34e85274ee6a28c3b0b80bb4bdf)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:50.660812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:50.668380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:50.669830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:50.670338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:50.672500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:50.673502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:50.678374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:50.679242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:50.711378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:50.739385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 907/1809] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:50.748729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:50.753149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:50.772569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d7e34e85274ee6a28c3b0b80bb4bdf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.789140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d7e34e85274ee6a28c3b0b80bb4bdf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.791078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d7e34e85274ee6a28c3b0b80bb4bdf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.793718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d7e34e85274ee6a28c3b0b80bb4bdf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.813094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d7e34e85274ee6a28c3b0b80bb4bdf'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:50.910676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 903/1810] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:50 2022] DELETE /identity/v3/users/26d7e34e85274ee6a28c3b0b80bb4bdf => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:50.971926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c470a-f4cb-4436-9ec9-c52f01cc8358 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:51.156672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:51.159831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.160230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.160608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:51.162872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:51.188558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:51.284321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 908/1811] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:50 2022] POST /identity/v3/users => generated 298 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:51.289323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:51.290965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:51.317278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0936207-c08f-4570-a54c-a135fedcd80f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:51.330562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:51.331535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.331934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.332452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:51.335016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:51.339893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:51.365112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 904/1812] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:51.370446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:51.387504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275b060-d56d-432e-9f57-e9d3d973ab64 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:51.426821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:51.426821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.426821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.426821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] PATH_INFO: `/v3/projects/f0245138d3b8471cb6623451505fcdaa/users/a7dd4b53bce2469db4ea636a8d90b700/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:51.465137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0245138d3b8471cb6623451505fcdaa, user_id=a7dd4b53bce2469db4ea636a8d90b700, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:51.486602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:51.526515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 909/1813] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:51 2022] PUT /identity/v3/projects/f0245138d3b8471cb6623451505fcdaa/users/a7dd4b53bce2469db4ea636a8d90b700/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:51.530922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:51.556390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7bea-d226-4902-914b-bd510ebeba46 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:51.801473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:51.801473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.801473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.801857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:51.802356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:51.804231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e917-1234-4350-a240-f9f81b67ee04 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:51.846083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 905/1814] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:51.848512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:51.877498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287dd9-7b00-457a-8f63-2e135786a4af admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:51.895730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:51.896679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.897570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.898957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] PATH_INFO: `/v3/projects/f0245138d3b8471cb6623451505fcdaa/users/a7dd4b53bce2469db4ea636a8d90b700/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:51.910523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0245138d3b8471cb6623451505fcdaa, user_id=a7dd4b53bce2469db4ea636a8d90b700, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:51.913277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:51.953293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 910/1815] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:51 2022] PUT /identity/v3/projects/f0245138d3b8471cb6623451505fcdaa/users/a7dd4b53bce2469db4ea636a8d90b700/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:51.967926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:51.967926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:51.969258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:52.059708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] MFA Rules not processed for user `a7dd4b53bce2469db4ea636a8d90b700`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:52.061330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:52.240136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:52.273285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 906/1816] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:52.289919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:52.291693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:52.409082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0c677-5ca2-4ecd-b8ff-d52ccdb60f6c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:52.413571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:52.414473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:52.414969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:52.415534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:52.426963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:52.436026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:52.439275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef9866-df82-48e7-896a-ec1f6df18765 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:52.471901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 911/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:52.808116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:52.809665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:52.970817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244de29-a9bd-4047-a1fb-26a2a3927716 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:52.990918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:52.991583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:52.991867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:52.992143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] PATH_INFO: `/v3/projects/c1332010b2f342e596e42f5ed0cf4c54` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:52.996729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1332010b2f342e596e42f5ed0cf4c54)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:52.998692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:53.107751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1332010b2f342e596e42f5ed0cf4c54', 'request_id': 'req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.123596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1332010b2f342e596e42f5ed0cf4c54', 'request_id': 'req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.153571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1332010b2f342e596e42f5ed0cf4c54', 'request_id': 'req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.205518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] The token cache is being invalidate because project c1332010b2f342e596e42f5ed0cf4c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:53.210147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.216618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-49fc0f92-0a66-44ff-bdb1-4b612d67fa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.224145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 907/1818] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:52 2022] DELETE /identity/v3/projects/c1332010b2f342e596e42f5ed0cf4c54 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:53.228935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.229442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.229528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.270697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:53.280430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.397534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 912/1819] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:53.405983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.406739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.407241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.437763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:53.439646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.456614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a018ec-dde2-4715-a6ac-64f2c9d9a43d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:53.462711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:53.462973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:53.463637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.463924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.464203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] PATH_INFO: `/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.464830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.465365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b0d21c8a294e348a797ff6c8e41ad7)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:53.468687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:53.493275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 908/1820] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:53.497311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:53.518501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918628d9-b082-4821-9cfe-b2da3c15a084 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:53.550637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'request_id': 'req-c2c374b5-56ef-4858-92cd-c54f2b1235f3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.562507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'request_id': 'req-c2c374b5-56ef-4858-92cd-c54f2b1235f3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.573866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b0d21c8a294e348a797ff6c8e41ad7', 'request_id': 'req-c2c374b5-56ef-4858-92cd-c54f2b1235f3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.592141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] The token cache is being invalidate because project f0b0d21c8a294e348a797ff6c8e41ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:53.592850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.594254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:53.599320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 913/1821] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:53 2022] DELETE /identity/v3/projects/f0b0d21c8a294e348a797ff6c8e41ad7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:53.599320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:53.599320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.620268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:53.620699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.621114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.621404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.622736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:53.623367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:53.625545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57640b35-6221-4899-bcc6-031853b6047d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:53.639771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 909/1822] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:53.641437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.641739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.642018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.664041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:53.665420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.674644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 910/1823] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:53.676023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:53.677353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.689990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41507-3974-41ce-9a4b-fbe74c230cfe None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:53.693108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c374b5-56ef-4858-92cd-c54f2b1235f3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:53.697396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:53.698027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.698304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.698581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.700443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.700981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:53.702338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.704279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.704697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.705812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:53.709469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5382d53-1934-4e3d-968f-9dbfd88c0bfa admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:53.715475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:53.784916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 911/1824] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:53.789307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:53.789597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:53.789871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:53.790828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:53.832195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:53.834139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:53.854482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:53.856347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:53.875498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 914/1825] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:53.876670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:53.907725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1b634-1932-4322-9346-785e71f8277a service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:53.972571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 912/1826] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:53.980069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.007249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a7796-4caf-4a8b-bf87-0b27c3605194 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.020768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.021523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.021978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.022352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.023152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:54.023557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.025729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.037418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.037960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.038252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.038531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.040777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 913/1827] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:54.043352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.045248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.048603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.067594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d8f36-a47d-4094-8bc8-30cd564b7d6b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.078472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.079434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.079806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.080086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.080866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.086511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.095689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 915/1828] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:53 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:54.099795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.125912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fbe8b-af64-45b3-ad2f-0c9f6147be2a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.132063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.132829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.133640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.133998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.134926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.137159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.155213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 916/1829] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:54.159087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.160566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 914/1830] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:54.164647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.181801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b110507-d255-4dce-92e9-aaf4d58b1673 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.288612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.290345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.290638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.293271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.296000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.298791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.314992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 917/1831] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:54.320068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.331969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca71b7-ea39-478d-9b06-95e663ca9a9c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.340072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.341967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.343529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.344566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.345537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.347970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.353342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5d8e9-ca2e-46c3-a801-2c1ffe148034 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.385718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.386427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.386766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.387819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] PATH_INFO: `/v3/projects/411907cf81a045a1afc3acc5fd38430f/users/b57ee881299d406b83974c83bb4b387d/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.393439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 915/1832] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:54.396734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.411004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069a68d-b0c5-4483-b13e-ae60da60bfc2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.419126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.420773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.421266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.422110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.424135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.429867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.443832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 916/1833] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:54.447215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411907cf81a045a1afc3acc5fd38430f, user_id=b57ee881299d406b83974c83bb4b387d, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.447363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.449966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fb40f-8c93-4fa2-8901-bcaa89c30815 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.473526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d16e3-bead-457b-aef2-4fd45ceee6d4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.498771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 918/1834] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:54 2022] PUT /identity/v3/projects/411907cf81a045a1afc3acc5fd38430f/users/b57ee881299d406b83974c83bb4b387d/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:54.500588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.500916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.501236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.522176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:54.537210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] MFA Rules not processed for user `071e49ba214a4ff1be50157f514fc2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:54.538647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:54.560244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:54.567486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.568267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.568706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.569048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.570293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.572262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a826c-3453-4335-8bd4-e396c32ea644 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.588593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 917/1835] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:54.588593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.588593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.588593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.612644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 919/1836] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:54.612644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.622475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a1d2f-738d-4491-a0fc-71c2b6b8c034 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.627016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] MFA Rules not processed for user `b57ee881299d406b83974c83bb4b387d`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:54.628228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:54.628343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.628972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.629262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.629540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] PATH_INFO: `/v3/projects/2eca449a6ec1477584f8612a3ed6e298/users/e9080e5af9954938a4423f9d90c98cef/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.650832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eca449a6ec1477584f8612a3ed6e298, user_id=e9080e5af9954938a4423f9d90c98cef, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.653769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91849bc-4898-4752-9317-403e45ab893a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.670469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 920/1837] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:54 2022] PUT /identity/v3/projects/2eca449a6ec1477584f8612a3ed6e298/users/e9080e5af9954938a4423f9d90c98cef/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:54.682262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.682741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.683035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.708952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 918/1838] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:54.713316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.720031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] MFA Rules not processed for user `e9080e5af9954938a4423f9d90c98cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:54.721430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:54.729464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3deae-92e6-4d66-9758-b6a7b76283ff None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.805205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 921/1839] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:54.817149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:54.817909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:54.818264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:54.818709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:54.819400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:54.820380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.821684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:54.879740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 919/1840] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:06:54.884275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:54.888909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c098fd-84e5-4d38-ae53-426e75e39bd9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:54.985540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:54.998738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.001205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.001808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.002231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.007867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:55.016593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7b72-74f0-4ed1-b293-1d50ccae2251 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.022792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.023403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.023788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.024167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.024968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.029016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.055394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 920/1841] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:54 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:55.062126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.071056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb2a91-bd39-44c0-bbb9-7e8292faa00a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.076464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.077234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.077657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.078295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.079097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.081720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.082588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.084393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.095396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 921/1842] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:55.097003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 922/1843] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:55.097831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.111150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde167b1-bba6-47b8-8f4d-0cc0941f6e9c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.119864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.120478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.121256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.121689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.122050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] PATH_INFO: `/v3/projects/b47fb10ee5194d1088ad076ecf47773b/users/863295259b404918b542ddae29c7eb75/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.133766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb278d-f52a-4046-a7c5-6d30d6967fc6 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.138295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47fb10ee5194d1088ad076ecf47773b, user_id=863295259b404918b542ddae29c7eb75, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.138746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.139709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.140053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.140417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] PATH_INFO: `/v3/users/e9080e5af9954938a4423f9d90c98cef` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.141786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.142189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9080e5af9954938a4423f9d90c98cef)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.144206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.157745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 922/1844] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:55 2022] PUT /identity/v3/projects/b47fb10ee5194d1088ad076ecf47773b/users/863295259b404918b542ddae29c7eb75/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:55.161757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.208293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9080e5af9954938a4423f9d90c98cef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:55.219455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9080e5af9954938a4423f9d90c98cef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:55.220060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9080e5af9954938a4423f9d90c98cef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:55.220971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9080e5af9954938a4423f9d90c98cef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:55.230767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7c7564bd-5b33-47fc-8cad-7b974a104910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9080e5af9954938a4423f9d90c98cef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:55.253135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f316b-b449-41f9-b106-6d41704d8019 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.257646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 923/1845] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:55 2022] DELETE /identity/v3/users/e9080e5af9954938a4423f9d90c98cef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:55.260776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.260776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.260776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.260776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.261166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.262800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.264458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ac14-d348-473c-9318-cf1bd95b28e5 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.265680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ac14-d348-473c-9318-cf1bd95b28e5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.266834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ac14-d348-473c-9318-cf1bd95b28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.281754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 923/1846] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:55.286690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.288772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.299256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e304ac14-d348-473c-9318-cf1bd95b28e5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:55.300465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e304ac14-d348-473c-9318-cf1bd95b28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.307244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee7a7-dcab-4c06-9019-84b2fe39d5d5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.388390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.389396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.389866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.390370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] PATH_INFO: `/v3/projects/b47fb10ee5194d1088ad076ecf47773b/users/863295259b404918b542ddae29c7eb75/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.393411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47fb10ee5194d1088ad076ecf47773b, user_id=863295259b404918b542ddae29c7eb75, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.398549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.410174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 924/1847] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:55.417147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 924/1848] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:55 2022] PUT /identity/v3/projects/b47fb10ee5194d1088ad076ecf47773b/users/863295259b404918b542ddae29c7eb75/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:55.430695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.431013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.431772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.465955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] MFA Rules not processed for user `863295259b404918b542ddae29c7eb75`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:55.467222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.474123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:55.533703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.535676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.591165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 925/1849] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:55.603283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:55.605683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.607398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.652658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ecd01-e50e-47c6-983e-7bb229433194 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.666495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.667479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.667479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.667760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.705947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0733d47-587f-482e-867e-ed83bbfab9ab None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.711786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.715176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.716188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.717927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.734819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.737089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932f0b6-d255-47b1-a02a-5efe84c3649e service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.772029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 926/1850] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:55.776364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f29f-1df8-4a9e-ab76-dcf8aa206ce9 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.777492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f29f-1df8-4a9e-ab76-dcf8aa206ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.777978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90f29f-1df8-4a9e-ab76-dcf8aa206ce9 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.781807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 927/1851] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:06:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:06:55.836258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25318-d60a-4b78-ac0c-0a641d9eeee6 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.836578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25318-d60a-4b78-ac0c-0a641d9eeee6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.836828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25318-d60a-4b78-ac0c-0a641d9eeee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.892469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f4c25318-d60a-4b78-ac0c-0a641d9eeee6 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:55.896003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f4c25318-d60a-4b78-ac0c-0a641d9eeee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:55.910917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.912599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:55.939034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 925/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:55.940744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:55.959793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1359b-19f9-4273-bd4a-4bc4ad15de84 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:55.967416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:55.975361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:55.975361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:55.975361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] PATH_INFO: `/v3/users/b57ee881299d406b83974c83bb4b387d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:55.981753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57ee881299d406b83974c83bb4b387d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:55.984423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:56.053374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 928/1853] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:56.074091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57ee881299d406b83974c83bb4b387d'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.085149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57ee881299d406b83974c83bb4b387d'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.087860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57ee881299d406b83974c83bb4b387d'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.089614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57ee881299d406b83974c83bb4b387d'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.104923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57ee881299d406b83974c83bb4b387d'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.132349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 926/1854] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:55 2022] DELETE /identity/v3/users/b57ee881299d406b83974c83bb4b387d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:56.137959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:56.138363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:56.138785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:56.172850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:56.174822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:56.222268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:56.275473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 929/1855] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:56.315397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:56.317640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:56.439485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:56.448825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b23c-9b18-46b8-92a9-22112c44889c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:56.454825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:56.455527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:56.455999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:56.456363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:56.474720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:56.476814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee93dc-d371-4558-8c02-3e8836a28ccb service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:56.489771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 927/1856] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:56.639894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:56.641524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:56.656279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba410c-ff5e-4c97-a3dd-203a4f5f2bc2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:56.674055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:56.674913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:56.675757 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:56.676141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] PATH_INFO: `/v3/projects/2eca449a6ec1477584f8612a3ed6e298` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:56.678281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eca449a6ec1477584f8612a3ed6e298)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:56.680389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:56.779753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eca449a6ec1477584f8612a3ed6e298', 'request_id': 'req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.786727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eca449a6ec1477584f8612a3ed6e298', 'request_id': 'req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.797096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eca449a6ec1477584f8612a3ed6e298', 'request_id': 'req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.811023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] The token cache is being invalidate because project 2eca449a6ec1477584f8612a3ed6e298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:56.811441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.812415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:56.815275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 930/1857] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:56 2022] DELETE /identity/v3/projects/2eca449a6ec1477584f8612a3ed6e298 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:56.820440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397c84-90d7-4d02-87b1-d205c8fff66d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:56.820726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397c84-90d7-4d02-87b1-d205c8fff66d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:56.820996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397c84-90d7-4d02-87b1-d205c8fff66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:56.854292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6d397c84-90d7-4d02-87b1-d205c8fff66d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:56.861227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6d397c84-90d7-4d02-87b1-d205c8fff66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:56.896172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:56.903797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.011850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 928/1858] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:57.022588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.023040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.023450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.051967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc456e0-dee2-4997-ba4b-9f5026fc9d65 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.061646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:57.064028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.068619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.069435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.069931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.070058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] PATH_INFO: `/v3/projects/411907cf81a045a1afc3acc5fd38430f` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.071617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411907cf81a045a1afc3acc5fd38430f)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.075321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.086523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 929/1859] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:06:57.090313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.113539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435f1b-d26d-4b4d-9b6d-934bbb2da299 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.122695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.123439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.123895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.124133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.127263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:57.130459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.135240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.168347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 930/1860] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:06:57.169418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.171621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.189399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411907cf81a045a1afc3acc5fd38430f', 'request_id': 'req-6e995fb2-51c8-4c5c-86da-ee6af07f2341'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.211479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411907cf81a045a1afc3acc5fd38430f', 'request_id': 'req-6e995fb2-51c8-4c5c-86da-ee6af07f2341'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.231219 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411907cf81a045a1afc3acc5fd38430f', 'request_id': 'req-6e995fb2-51c8-4c5c-86da-ee6af07f2341'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.233762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:57.272909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] The token cache is being invalidate because project 411907cf81a045a1afc3acc5fd38430f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:57.273216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.273936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.278736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 931/1861] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:56 2022] DELETE /identity/v3/projects/411907cf81a045a1afc3acc5fd38430f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:57.278736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.280362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.327257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ee16-5282-457a-b763-12d16bd35113 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.426074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e995fb2-51c8-4c5c-86da-ee6af07f2341 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.439732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.440357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.440673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.440914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.441590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.443732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.510449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 932/1862] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:57 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:57.511304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.513049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.518698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.521937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.524398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.525362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.551357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:57.612105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.615344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.621180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:57.647499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 931/1863] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:57.652127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.678401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee430dad-7a91-415d-b444-a66ef923b215 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.711832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a0879-0723-4edb-8416-83b923b453ae admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:57.727763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.728926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.728926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.729474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] PATH_INFO: `/v3/users/863295259b404918b542ddae29c7eb75` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.732818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] RBAC: Authorizing `identity:delete_user(user_id=863295259b404918b542ddae29c7eb75)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.735729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.891259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:57.892888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:57.894850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:57.896482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:57.899078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:57.911241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:57.915125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863295259b404918b542ddae29c7eb75'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.935358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863295259b404918b542ddae29c7eb75'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.936055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863295259b404918b542ddae29c7eb75'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.937257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863295259b404918b542ddae29c7eb75'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.956601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863295259b404918b542ddae29c7eb75'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:57.974115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 932/1864] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:57 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:57.976435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:57.981477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:58.010707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138683b7-d4f8-47c3-95e6-fe9c71b905ad admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:58.011899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:58.025285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:58.026046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.026448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.028401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.032779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:58.033220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 933/1865] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:06:57 2022] DELETE /identity/v3/users/863295259b404918b542ddae29c7eb75 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:58.033937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:58.068670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 933/1866] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:58.070389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:58.169948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fb075-c4be-42ee-ba96-c9868708331e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:58.177111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:58.185179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.190094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.190503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.191396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:58.196512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ebbf-249d-4f9d-977a-f91b4616f2c7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:58.229209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:58.238894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 934/1867] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:06:58.245662 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518a725-5fb2-4285-b894-918bb2df68d6 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:58.258448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:58.260654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.261064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.263061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] PATH_INFO: `/v3/projects/a827287b9f9c445bb1e2fbc3878c24d6/users/76daa708e6474609963897aea0981b4a/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.298714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a827287b9f9c445bb1e2fbc3878c24d6, user_id=76daa708e6474609963897aea0981b4a, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:58.302151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:58.326129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 934/1868] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:58 2022] PUT /identity/v3/projects/a827287b9f9c445bb1e2fbc3878c24d6/users/76daa708e6474609963897aea0981b4a/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:06:58.338787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.339374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.339941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.400728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] MFA Rules not processed for user `76daa708e6474609963897aea0981b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:58.409004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:58.541360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 935/1869] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:58.550578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:58.553694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:58.636353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:58.637911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd201b3-fb0c-43f2-9d2c-4c605b5f9c90 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:58.638290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:58.643219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:58.644084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.644552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.645281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.656639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:58.658513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec479e-8423-46a0-8e1e-9fe5249a76eb service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:58.678821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 935/1870] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:06:58.821063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3496d-b477-4df8-bba1-06798e41638f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:58.828299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:58.829259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.829748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.830225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] PATH_INFO: `/v3/projects/b47fb10ee5194d1088ad076ecf47773b` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.831679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47fb10ee5194d1088ad076ecf47773b)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:58.834011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:58.864707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:58.903849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47fb10ee5194d1088ad076ecf47773b', 'request_id': 'req-c9743568-169c-406f-8af3-6d9e2c0e6789'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:58.913934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47fb10ee5194d1088ad076ecf47773b', 'request_id': 'req-c9743568-169c-406f-8af3-6d9e2c0e6789'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:58.924415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47fb10ee5194d1088ad076ecf47773b', 'request_id': 'req-c9743568-169c-406f-8af3-6d9e2c0e6789'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:58.937383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] The token cache is being invalidate because project b47fb10ee5194d1088ad076ecf47773b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:06:58.937690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:58.938358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c9743568-169c-406f-8af3-6d9e2c0e6789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:06:58.941256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 936/1871] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:06:58 2022] DELETE /identity/v3/projects/b47fb10ee5194d1088ad076ecf47773b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:58.948702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:58.949884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:58.950331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:58.979121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:58.984199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:59.104817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:59.156649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 936/1872] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:59.162406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.163154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.163154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.222485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:59.225806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:59.245660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 937/1873] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:59.249171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.266815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a462-fc39-41ea-b791-b0837cf677ae None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.276537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.278196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.278555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.279296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.282334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:06:59.283282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.284540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.314004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 937/1874] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:06:59.318250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.331111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad475-3eb9-4ed1-921a-229e05688369 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.338443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.339349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.339567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.339846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.340499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.342482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.380322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 938/1875] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/projects => generated 407 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:59.383753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.396313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6ecb-18c1-4bb7-b0a3-adc7dff758c2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.425549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.427266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:59.462163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.462716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.463009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.463285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.463925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.465839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.491058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 938/1876] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/users => generated 304 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:59.491389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9fc4-786a-472d-9d5e-b3280f0494c4 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.492609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.493213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.493971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.494257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.494566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.496343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:59.503730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d234-729c-419d-ad38-91e7e6101436 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.508734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.509365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.509638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.509909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.510796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.512433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.524034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 939/1877] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:59.527956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.538133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198ceda-ebed-4577-b97d-47be8de69198 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.542673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.543255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.543535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.543807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.544431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.546846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.556808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 940/1878] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:06:59.561012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.563607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.565054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5ca0b-2cdc-4daf-a5c8-82f9071a3683 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.570344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcefee-ec03-43ed-b0b2-8833fd329c51 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.574132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 939/1879] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:06:59.575120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.575858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.576145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.576419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] PATH_INFO: `/v3/projects/b64119fa0f904573a4deaa03264e70bc/users/0e2c7ac60a414a4ea011973ce62b93e3/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.591124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64119fa0f904573a4deaa03264e70bc, user_id=0e2c7ac60a414a4ea011973ce62b93e3, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.594812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.607761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 941/1880] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:06:59 2022] PUT /identity/v3/projects/b64119fa0f904573a4deaa03264e70bc/users/0e2c7ac60a414a4ea011973ce62b93e3/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:06:59.618224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.618509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.618818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.648107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] MFA Rules not processed for user `0e2c7ac60a414a4ea011973ce62b93e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:06:59.649319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:06:59.679093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:59.729927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 940/1881] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:06:59.735163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.845246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce763a-5191-46ad-878c-7c459a5e28e6 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:06:59.859270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:06:59.860265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:06:59.860772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:06:59.861262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:06:59.862107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:06:59.864385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:06:59.912965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 942/1882] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:06:59.917796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:06:59.930809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59c5a5-ae59-43f3-9d52-1c5837059e73 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.020220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.021140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.021517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.021866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.022579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.024652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.052982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 941/1883] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:06:59 2022] POST /identity/v3/users => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:00.056915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:00.077551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa7135-2bf8-479b-a00a-8121bc78db48 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.089573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.092385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.092691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.093530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.094220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.098215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.107935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:00.126458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:00.127082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 943/1884] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:00.145767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178bc7e-d700-42b1-9455-a6d833da0a1f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.158335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.159272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.162021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.162977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] PATH_INFO: `/v3/projects/80b3d9a601134f9991a31f9fae6d0be0/users/54bfa0e884da412890d3991fd9ba78eb/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.189277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b3d9a601134f9991a31f9fae6d0be0, user_id=54bfa0e884da412890d3991fd9ba78eb, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.192054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.232089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:00.232634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 942/1885] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:00 2022] PUT /identity/v3/projects/80b3d9a601134f9991a31f9fae6d0be0/users/54bfa0e884da412890d3991fd9ba78eb/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:00.243950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bfd7b-84ef-4f0c-8b3f-50fb26efb060 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.350866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.353557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.355667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.356830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.358419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.363824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcab54-e933-48fb-ba1f-e3e09b9d8944 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.385947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 944/1886] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:00.391723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:00.407563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42e63-1631-47dd-ad3e-9b67b14830be admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.415978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.416978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.417262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.417542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] PATH_INFO: `/v3/projects/80b3d9a601134f9991a31f9fae6d0be0/users/54bfa0e884da412890d3991fd9ba78eb/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.420053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b3d9a601134f9991a31f9fae6d0be0, user_id=54bfa0e884da412890d3991fd9ba78eb, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.423303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.435078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 943/1887] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:00 2022] PUT /identity/v3/projects/80b3d9a601134f9991a31f9fae6d0be0/users/54bfa0e884da412890d3991fd9ba78eb/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:00.447095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.447393 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.447675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.507852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] MFA Rules not processed for user `54bfa0e884da412890d3991fd9ba78eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:00.510569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:00.635792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 945/1888] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:00.683308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:00.689718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:00.800301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174aef4-f069-4be3-b7c9-8c29d3b75294 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:00.805426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:00.806069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:00.806354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:00.806629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:00.819321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:00.820843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fd994-621d-4b9a-800e-07dc59ba1c79 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:00.839477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 944/1889] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:00 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:01.160205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:01.174670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c565-bf7b-4f54-adc2-9d2a7006b53d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:01.185274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:01.185877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:01.186161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:01.186433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:01.252287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca33e3-0f7f-407b-a06d-a897f3228fe3 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:01.254017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca33e3-0f7f-407b-a06d-a897f3228fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:01.254523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca33e3-0f7f-407b-a06d-a897f3228fe3 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:01.256843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 945/1890] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:07:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:07:01.270971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:01.271675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:01.272098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:01.323951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:01.328921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:01.332086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:01.336244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:01.344333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 946/1891] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:01.388662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:01.471975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 946/1892] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:07:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:01.569796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:01.572055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:01.593547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c7cf-da2a-4e0e-bc55-baffaac3a8e6 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:01.604204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:01.605471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:01.606020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:01.606456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:01.624707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:01.630727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193566-0390-4600-9f78-68ec74cd9cee service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:01.668546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 947/1893] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:02.823265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:02.825746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:02.977709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce2f6-ed67-41aa-9592-261aaf929b1f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:02.991980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:02.993507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:02.993804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:02.994084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] PATH_INFO: `/v3/users/08a658053ee34a0dbf6135de0d409b80` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:02.996179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a658053ee34a0dbf6135de0d409b80)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:02.998123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:03.091912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a658053ee34a0dbf6135de0d409b80'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:03.117181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a658053ee34a0dbf6135de0d409b80'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:03.117929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a658053ee34a0dbf6135de0d409b80'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:03.118618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a658053ee34a0dbf6135de0d409b80'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:03.138935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a658053ee34a0dbf6135de0d409b80'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:03.161611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 947/1894] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:02 2022] DELETE /identity/v3/users/08a658053ee34a0dbf6135de0d409b80 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:03.166054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:03.166587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:03.166587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:03.176783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:03.205479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:03.207150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:03.351875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 948/1895] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:03.365448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:03.367660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:03.446538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:03.500596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9ee3e-4dee-438f-bf36-c9cffbb3dc13 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:03.505137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:03.505871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:03.507855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:03.507855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:03.520832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:03.523002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:03.551860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 948/1896] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:04.218755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:04.221211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:04.233830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822303dc-2dbb-40ae-89d5-89e781952d8c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:04.239924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:04.240887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:04.241368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:04.241837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] PATH_INFO: `/v3/projects/45b2f1211df446bfaa49860f32146646` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:04.243233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b2f1211df446bfaa49860f32146646)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:04.245339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:04.329791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b2f1211df446bfaa49860f32146646', 'request_id': 'req-f619c92a-cd77-4e32-88bf-05500a1af90f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.342476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b2f1211df446bfaa49860f32146646', 'request_id': 'req-f619c92a-cd77-4e32-88bf-05500a1af90f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.351530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b2f1211df446bfaa49860f32146646', 'request_id': 'req-f619c92a-cd77-4e32-88bf-05500a1af90f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.365679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] The token cache is being invalidate because project 45b2f1211df446bfaa49860f32146646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:04.365929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.366534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.368285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 949/1897] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:04 2022] DELETE /identity/v3/projects/45b2f1211df446bfaa49860f32146646 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:04.372785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:04.385058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416682-5023-489c-b66b-2c8d2ade265f service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:04.462185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:04.467083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:04.467676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:04.468947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] PATH_INFO: `/v3/users/964222ea13274318bbb7aadd0587ee0e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:04.470564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964222ea13274318bbb7aadd0587ee0e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:04.473150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:04.528507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964222ea13274318bbb7aadd0587ee0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.536633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964222ea13274318bbb7aadd0587ee0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.537580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964222ea13274318bbb7aadd0587ee0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.538406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964222ea13274318bbb7aadd0587ee0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.546440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964222ea13274318bbb7aadd0587ee0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:04.574808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 949/1898] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:04 2022] DELETE /identity/v3/users/964222ea13274318bbb7aadd0587ee0e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:05.118698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:05.120172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:05.134978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c92a-cd77-4e32-88bf-05500a1af90f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:05.237913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:05.238637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:05.239081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:05.239391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] PATH_INFO: `/v3/projects/2f356ccde8154b31a017627a574bf11e` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:05.242379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f356ccde8154b31a017627a574bf11e)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:05.244384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:05.277810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:05.296956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f356ccde8154b31a017627a574bf11e', 'request_id': 'req-0eea53de-e759-4991-aeab-2e70b4fd8ca7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.304379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f356ccde8154b31a017627a574bf11e', 'request_id': 'req-0eea53de-e759-4991-aeab-2e70b4fd8ca7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.313187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f356ccde8154b31a017627a574bf11e', 'request_id': 'req-0eea53de-e759-4991-aeab-2e70b4fd8ca7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.324840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] The token cache is being invalidate because project 2f356ccde8154b31a017627a574bf11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:05.325051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.325758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.327696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 950/1899] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:05 2022] DELETE /identity/v3/projects/2f356ccde8154b31a017627a574bf11e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:05.331861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:05.333600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:05.353110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d67fed-30e6-4075-b655-98e49caf1e85 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:05.416750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:05.425134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:05.425772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:05.426056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:05.426579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] PATH_INFO: `/v3/users/a7dd4b53bce2469db4ea636a8d90b700` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:05.427980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dd4b53bce2469db4ea636a8d90b700)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:05.429913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:05.459925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:05.461793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:05.475123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea53de-e759-4991-aeab-2e70b4fd8ca7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:05.481181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:05.482032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:05.482468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:05.482959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] PATH_INFO: `/v3/users/76daa708e6474609963897aea0981b4a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:05.483932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dd4b53bce2469db4ea636a8d90b700'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.485086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76daa708e6474609963897aea0981b4a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:05.487344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:05.492468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dd4b53bce2469db4ea636a8d90b700'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.493106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dd4b53bce2469db4ea636a8d90b700'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.493723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dd4b53bce2469db4ea636a8d90b700'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.502345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c38d69ca-4832-4856-99c0-dd19e1418d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dd4b53bce2469db4ea636a8d90b700'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.521353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 950/1900] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:05 2022] DELETE /identity/v3/users/a7dd4b53bce2469db4ea636a8d90b700 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:05.536163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76daa708e6474609963897aea0981b4a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.544310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76daa708e6474609963897aea0981b4a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.545117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76daa708e6474609963897aea0981b4a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.545836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76daa708e6474609963897aea0981b4a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.553674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76daa708e6474609963897aea0981b4a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:05.574607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 951/1901] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:05 2022] DELETE /identity/v3/users/76daa708e6474609963897aea0981b4a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:05.579162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:05.579390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:05.579666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:05.600194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:05.601413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:05.673802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 951/1902] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:05.686363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:05.688046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:05.747652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84bacb-7e4f-460e-bff7-58f9b4d4d120 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:05.752055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:05.753021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:05.753314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:05.753591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:05.763214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:05.765422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af7457-1e96-4017-bf98-8232e85a2bab service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:05.782049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 952/1903] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:06.057295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.058783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.072992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035096-b234-4316-af7b-b7405a032b17 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.078619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.079300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.079627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.079882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] PATH_INFO: `/v3/projects/f0245138d3b8471cb6623451505fcdaa` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.080962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0245138d3b8471cb6623451505fcdaa)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.095259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.187164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0245138d3b8471cb6623451505fcdaa', 'request_id': 'req-e59b141f-cf77-4490-aad5-30754d5773c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.195497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0245138d3b8471cb6623451505fcdaa', 'request_id': 'req-e59b141f-cf77-4490-aad5-30754d5773c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.212329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0245138d3b8471cb6623451505fcdaa', 'request_id': 'req-e59b141f-cf77-4490-aad5-30754d5773c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.223344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:06.229387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] The token cache is being invalidate because project f0245138d3b8471cb6623451505fcdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:06.230472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.232204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e59b141f-cf77-4490-aad5-30754d5773c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.247786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 952/1904] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:06 2022] DELETE /identity/v3/projects/f0245138d3b8471cb6623451505fcdaa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:06.253263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.253730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.253919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.292252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:06.293677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.351640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:06.406544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 953/1905] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:06.415059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.415681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.415961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.445661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:06.447620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.459205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 953/1906] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:06.463420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.474473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0795a2a-bf64-4c48-90aa-df174323ed8a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.482349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.484427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.484766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.487680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.487680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:06.487680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.488940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.489544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.494159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.506242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 954/1907] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:06.511075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.518989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733ece2-627c-46a6-bee0-75e56fbf8bde None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.526833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.528062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.528356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.528970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] PATH_INFO: `/v3/projects/a827287b9f9c445bb1e2fbc3878c24d6` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.530333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a827287b9f9c445bb1e2fbc3878c24d6)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.534045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.550602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ff3f-0e9d-480b-a664-d56bf64d9df1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.558239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.558597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.558993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.570936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.570936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.570936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.600441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 955/1908] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:06.606459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.617266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a827287b9f9c445bb1e2fbc3878c24d6', 'request_id': 'req-2c325117-81b2-43bb-a7ce-559f2a13709b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.625246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a827287b9f9c445bb1e2fbc3878c24d6', 'request_id': 'req-2c325117-81b2-43bb-a7ce-559f2a13709b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.634495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a827287b9f9c445bb1e2fbc3878c24d6', 'request_id': 'req-2c325117-81b2-43bb-a7ce-559f2a13709b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.649415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] The token cache is being invalidate because project a827287b9f9c445bb1e2fbc3878c24d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:06.649783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.650384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2c325117-81b2-43bb-a7ce-559f2a13709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:06.654713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 954/1909] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:06 2022] DELETE /identity/v3/projects/a827287b9f9c445bb1e2fbc3878c24d6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:06.657224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc29d-1b63-4083-a928-b00fd91ed262 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.657732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc29d-1b63-4083-a928-b00fd91ed262 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.657862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbc29d-1b63-4083-a928-b00fd91ed262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.682336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98934c3-9fd8-4958-915b-00f0f00ed3e1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.683841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b4cbc29d-1b63-4083-a928-b00fd91ed262 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:06.685275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b4cbc29d-1b63-4083-a928-b00fd91ed262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.687974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.688998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.689504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.689991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.690670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.692622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.700242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 955/1910] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:06.703569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.703865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.704145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.721147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 956/1911] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:06.722608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.724635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.728054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:06.729305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.739862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 956/1912] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:06.742004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a536-34f7-4cbf-9656-5a6a71450017 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.745388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.751337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.752067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.752427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.752777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.753502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.755459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.756442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a7e3-c0a7-4157-9c6d-6acff3a128b9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.762513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.763344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.763654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.763930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.765406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:06.765871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.767553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.771407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 957/1913] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:06.772290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.784254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 957/1914] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:06.785283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.787177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a495fd9-1bfb-4e03-930d-bf32a1e9a153 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.791840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.792454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.792735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.793005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.793797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.795442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.795845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437c5a-fcf0-4f23-b008-20aac73b109e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.801350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.802507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.802823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.803101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.803779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.805714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.811930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 958/1915] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:06.812936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.823305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4d846-a676-46fc-872e-52674bb9ebd4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.829256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:06.829977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.830325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.830594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] PATH_INFO: `/v3/projects/5e5ffde894964cd28f199e4542ddb670/users/8df92ae284e94de78a7270d02fa3892b/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.839424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 958/1916] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:06.844684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:06.848531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5ffde894964cd28f199e4542ddb670, user_id=8df92ae284e94de78a7270d02fa3892b, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:06.852149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6126b2-76de-453f-aac8-9dc1495cdbaf admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:06.879134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 959/1917] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:06 2022] PUT /identity/v3/projects/5e5ffde894964cd28f199e4542ddb670/users/8df92ae284e94de78a7270d02fa3892b/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:06.881090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:06.881386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:06.881667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:06.911861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] MFA Rules not processed for user `8df92ae284e94de78a7270d02fa3892b`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:06.913748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:06.920145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495d93e-72eb-43d0-b60e-b2d31aae9649 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:06.944685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:06.964331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:06.997048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 960/1918] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:07.001450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.002529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.003313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.003599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.003878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.004521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.006610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.014170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666806c-3844-4a61-8446-b153d39c8eef None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.021044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.021705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.021992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.022262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.023005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.025126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.037450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 959/1919] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:06 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:07.038372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.049835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86644107-984c-4591-b12d-03b41d7b57fd admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.055412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.056634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.057261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.057642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.058404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.060463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.082226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 961/1920] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:07.086355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.089387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 960/1921] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:07.094025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.106455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f8ea5-4913-4edb-9a1c-58f8427302eb admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.169326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29c9a-b311-4516-9259-c46e68e09b61 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.174456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.175085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.175370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.175648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.176290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.178224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.184399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.185270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.185560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.185837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.186704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.188461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.205302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 962/1922] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:07.206841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 961/1923] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:07.208240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.209578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.220551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ae89-5973-445f-82c0-4b32989e07eb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.225398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.226016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc4c22-87dd-432e-8754-68a4d3dd84e5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.226328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.226722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.227604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.227881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.229686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.231862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.232525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.232810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.233754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] PATH_INFO: `/v3/projects/3426128b6cf94530a768941fb77c9700/users/2053da1e91ef44609e183302e8825513/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.242120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 963/1924] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:07.246249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.253367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3426128b6cf94530a768941fb77c9700, user_id=2053da1e91ef44609e183302e8825513, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.256274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbab81-6751-45f3-81cd-2af89a3a99de admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.256834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824ec69-c7f1-4ca4-bf97-5f29b5400391 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.261928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.262642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.262998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.263285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] PATH_INFO: `/v3/projects/7d5f193b9c1449c8a53600c43f100fa9/users/6488eea59a7e41ef8d4aa624c02e70da/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.274212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 962/1925] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:07 2022] PUT /identity/v3/projects/3426128b6cf94530a768941fb77c9700/users/2053da1e91ef44609e183302e8825513/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:07.286354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.286613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.286957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.289469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5f193b9c1449c8a53600c43f100fa9, user_id=6488eea59a7e41ef8d4aa624c02e70da, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.292352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.313506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 964/1926] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:07 2022] PUT /identity/v3/projects/7d5f193b9c1449c8a53600c43f100fa9/users/6488eea59a7e41ef8d4aa624c02e70da/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:07.318034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.339876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] MFA Rules not processed for user `2053da1e91ef44609e183302e8825513`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:07.341281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:07.437962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3b6d7-a4c9-40d0-acd9-6a435a2fff5f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.443844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.444474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.444895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.445175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.445996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.448427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.452576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:07.464262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 963/1927] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:07.469265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.480065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 965/1928] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:07.481204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.482387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5a40-fdfd-4fad-b312-3e9ce90ffc7e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.489144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.490486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.490819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.491104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.491755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.493993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.497372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041041f-026f-49b1-a32c-89425c7136b4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.504156 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.505154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.505893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.506354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] PATH_INFO: `/v3/projects/7d5f193b9c1449c8a53600c43f100fa9/users/6488eea59a7e41ef8d4aa624c02e70da/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.507404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:07.510344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5f193b9c1449c8a53600c43f100fa9, user_id=6488eea59a7e41ef8d4aa624c02e70da, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.513695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab0971-24be-43c4-b112-a4040836d387 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.532075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 966/1929] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:07 2022] PUT /identity/v3/projects/7d5f193b9c1449c8a53600c43f100fa9/users/6488eea59a7e41ef8d4aa624c02e70da/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:07.554692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.554692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.554692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.555164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 964/1930] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:07.555164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.616126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] MFA Rules not processed for user `6488eea59a7e41ef8d4aa624c02e70da`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:07.617391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:07.703834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187f3db-b7da-40d1-9254-b75cdcad8528 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.716188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.717210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.718165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.719412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.720794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.724651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.781247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 967/1931] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:07.788082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.790770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:07.799664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 965/1932] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:07 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:07.803531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.809069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:07.814574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40aeac6-ad6f-468c-b9f4-e96324b21ae1 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.822502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.823526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.824385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.825007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] PATH_INFO: `/v3/users/0e2c7ac60a414a4ea011973ce62b93e3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.828579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2c7ac60a414a4ea011973ce62b93e3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.830719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.914225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5e66-a307-4d63-a4fc-8c8245f60bdf admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.918621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.919373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.919730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.920120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.928721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2c7ac60a414a4ea011973ce62b93e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:07.932255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.933876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.939298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2c7ac60a414a4ea011973ce62b93e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:07.940555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2c7ac60a414a4ea011973ce62b93e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:07.941784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2c7ac60a414a4ea011973ce62b93e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:07.948071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 966/1933] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:07.949198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.963113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaf824-a1fc-4fd9-b512-2f51b6ac230a service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:07.969059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-39bbb797-2823-40fb-a060-d962d495be7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2c7ac60a414a4ea011973ce62b93e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:07.969853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:07.971159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:07.971805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:07.972228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:07.973159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:07.974974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:07.987764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 967/1934] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:07.993604 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:07.996609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:08.026534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925754b0-ceca-43c4-b423-1be7f51f40e2 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:08.033277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:08.034143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.034597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 968/1935] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:07 2022] DELETE /identity/v3/users/0e2c7ac60a414a4ea011973ce62b93e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:08.034788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.038704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.039235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.039627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.039897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:08.040191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.042610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:08.060894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 968/1936] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:08.062882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:08.076036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a9394-56a9-4220-b14b-72497f2dd7c1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:08.078544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:08.079906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:08.176287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:08.236379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 969/1937] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:08.244602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:08.245354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.247464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:08.249949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:08.250488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.250714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] PATH_INFO: `/v3/projects/bbb51a517df140ce9139ef79d53237ab/users/97e9b19f50e34de1a6ee37a44140f77b/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.267594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:08.311674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb51a517df140ce9139ef79d53237ab, user_id=97e9b19f50e34de1a6ee37a44140f77b, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:08.314937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f57e-0d50-470e-a38d-df665e78c916 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:08.339631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 969/1938] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:08 2022] PUT /identity/v3/projects/bbb51a517df140ce9139ef79d53237ab/users/97e9b19f50e34de1a6ee37a44140f77b/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:08.352285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.352813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.354710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.395168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b4fce-4e3f-4ce5-8277-978191cb433c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:08.431115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] MFA Rules not processed for user `97e9b19f50e34de1a6ee37a44140f77b`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:08.433325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:08.536307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:08.537010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.537294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.537571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.596811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 970/1939] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:08.597523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:08.641226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:08.643154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:08.706974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 970/1940] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:08.718424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0e4e-29f7-4e8d-a944-bbe33e82eedd None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:08.724314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:08.724956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.725301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.725587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.727011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:08.730289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:08.781242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 971/1941] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:08 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:08.782049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:08.798538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220630-bdc8-4777-afc7-97792815b939 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:08.881963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:08.911974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:08.912612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:08.912896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:08.920975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:08.921974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:08.925143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:08.992511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 971/1942] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:08 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:08.996662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.011123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f3093-dfc2-4c39-9d27-9aeacf384ec3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.024479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.025311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.025770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.026240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.027090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.028955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.047674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.047849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 972/1943] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:09.049311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.051496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.062893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb48191-28a4-4fc5-a1ad-2ecd854b58a1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.067176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408f84-6f4b-4568-8450-f0678eee95db admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.069438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.070253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.070542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.070852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] PATH_INFO: `/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e/users/4b540df5abaa4f8e8c25b75b42f2c4ae/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.073724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.074506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.074989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.075368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] PATH_INFO: `/v3/users/8df92ae284e94de78a7270d02fa3892b` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.077054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df92ae284e94de78a7270d02fa3892b)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.079456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.114885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d6ac7c968049cba1b7b4cd2abc7a6e, user_id=4b540df5abaa4f8e8c25b75b42f2c4ae, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.117768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.171230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 972/1944] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:09 2022] PUT /identity/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e/users/4b540df5abaa4f8e8c25b75b42f2c4ae/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:09.174736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.190061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:09.208802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df92ae284e94de78a7270d02fa3892b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:09.232584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df92ae284e94de78a7270d02fa3892b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:09.234184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df92ae284e94de78a7270d02fa3892b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:09.235114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df92ae284e94de78a7270d02fa3892b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:09.253328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f79d24c4-607e-4232-957d-0c6c56c41aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df92ae284e94de78a7270d02fa3892b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:09.327492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 973/1945] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:09 2022] DELETE /identity/v3/users/8df92ae284e94de78a7270d02fa3892b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:09.331610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.333285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.333579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.406755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:09.410449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.425051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0773e9-016e-4484-a976-67d9f9b4002d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.523831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 974/1946] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:09.539679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.540435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.541207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.541207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.541497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.542002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.543801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.544261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.556772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 973/1947] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:09.560606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.563768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.597642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ad548-159f-4a92-acb4-07026d01e7fa admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.615026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.618464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.620125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.620414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] PATH_INFO: `/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e/users/4b540df5abaa4f8e8c25b75b42f2c4ae/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.630060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d6ac7c968049cba1b7b4cd2abc7a6e, user_id=4b540df5abaa4f8e8c25b75b42f2c4ae, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.638379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350422-46fc-4840-b857-65c25e4657b8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.664154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 974/1948] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:09 2022] PUT /identity/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e/users/4b540df5abaa4f8e8c25b75b42f2c4ae/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:09.677398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.677746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.677974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.714515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a925bc-f4c1-4dae-8a70-978936f94a75 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.749496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] MFA Rules not processed for user `4b540df5abaa4f8e8c25b75b42f2c4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:09.752172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.785475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.786475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.786802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.787079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.835828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:09.841641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:09.905385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 975/1949] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:09.905385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.905385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.912911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.914835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:09.920865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159635-1e51-489f-a3f5-9049bc4220de None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:09.927335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:09.927767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 975/1950] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:09.928640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:09.931784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:09.942042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:09.942587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:09.943049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] PATH_INFO: `/v3/projects/b64119fa0f904573a4deaa03264e70bc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:09.946875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64119fa0f904573a4deaa03264e70bc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:09.949199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:10.028473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eac34-cca5-4410-be36-3c3fd0a57456 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:10.049488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64119fa0f904573a4deaa03264e70bc', 'request_id': 'req-afc38311-a16b-471f-b51a-c1f01a8a975e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.065182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64119fa0f904573a4deaa03264e70bc', 'request_id': 'req-afc38311-a16b-471f-b51a-c1f01a8a975e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.084413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64119fa0f904573a4deaa03264e70bc', 'request_id': 'req-afc38311-a16b-471f-b51a-c1f01a8a975e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.107986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] The token cache is being invalidate because project b64119fa0f904573a4deaa03264e70bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:10.110311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.113001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.121983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 976/1951] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:09 2022] DELETE /identity/v3/projects/b64119fa0f904573a4deaa03264e70bc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:10.122945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:10.126017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:10.163373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:10.172108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:10.173317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:10.175259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:10.193106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:10.352372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc38311-a16b-471f-b51a-c1f01a8a975e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:10.363453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:10.364494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:10.365128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:10.365838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] PATH_INFO: `/v3/users/54bfa0e884da412890d3991fd9ba78eb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:10.367394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bfa0e884da412890d3991fd9ba78eb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:10.371406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:10.400025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:10.401872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:10.440674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 976/1952] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:10.485814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bfa0e884da412890d3991fd9ba78eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.499213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bfa0e884da412890d3991fd9ba78eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.502911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bfa0e884da412890d3991fd9ba78eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.503971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bfa0e884da412890d3991fd9ba78eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.508296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:10.536311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bfa0e884da412890d3991fd9ba78eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.573094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:10.574871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:10.591365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 977/1953] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:10 2022] DELETE /identity/v3/users/54bfa0e884da412890d3991fd9ba78eb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:10.607417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618432f-e342-4b9c-8e8b-c0840dba2309 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:10.694945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:10.744592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:10.746186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:10.746499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:10.746786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] PATH_INFO: `/v3/projects/5e5ffde894964cd28f199e4542ddb670` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:10.748292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5ffde894964cd28f199e4542ddb670)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:10.751202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:10.869209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5ffde894964cd28f199e4542ddb670', 'request_id': 'req-6e25405b-1b6a-4e07-a21e-d2445db791ef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.883972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5ffde894964cd28f199e4542ddb670', 'request_id': 'req-6e25405b-1b6a-4e07-a21e-d2445db791ef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.899998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5ffde894964cd28f199e4542ddb670', 'request_id': 'req-6e25405b-1b6a-4e07-a21e-d2445db791ef'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.975756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] The token cache is being invalidate because project 5e5ffde894964cd28f199e4542ddb670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:10.976799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.980649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:10.984892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 977/1954] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:10 2022] DELETE /identity/v3/projects/5e5ffde894964cd28f199e4542ddb670 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:10.988964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:10.990537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:11.018055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed35c7-e2ad-490f-8922-c903a87bf397 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:11.124277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:11.124987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:11.125353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:11.125750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] PATH_INFO: `/v3/users/6488eea59a7e41ef8d4aa624c02e70da` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:11.127056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6488eea59a7e41ef8d4aa624c02e70da)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:11.129069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:11.264850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6488eea59a7e41ef8d4aa624c02e70da'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.275147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6488eea59a7e41ef8d4aa624c02e70da'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.276325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6488eea59a7e41ef8d4aa624c02e70da'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.277465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6488eea59a7e41ef8d4aa624c02e70da'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.289062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6488eea59a7e41ef8d4aa624c02e70da'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.315880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 978/1955] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:10 2022] DELETE /identity/v3/users/6488eea59a7e41ef8d4aa624c02e70da => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:11.541440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:11.543075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:11.556817 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25405b-1b6a-4e07-a21e-d2445db791ef admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:11.667891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:11.668542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:11.668821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:11.669105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] PATH_INFO: `/v3/projects/80b3d9a601134f9991a31f9fae6d0be0` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:11.671426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b3d9a601134f9991a31f9fae6d0be0)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:11.673438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:11.752598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b3d9a601134f9991a31f9fae6d0be0', 'request_id': 'req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.763349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b3d9a601134f9991a31f9fae6d0be0', 'request_id': 'req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.782539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b3d9a601134f9991a31f9fae6d0be0', 'request_id': 'req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.793769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:11.801897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] The token cache is being invalidate because project 80b3d9a601134f9991a31f9fae6d0be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:11.802386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.803990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:11.805898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:11.811071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-763be8f1-cff5-47c1-b3b1-dd59d83bb0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:11.829577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 978/1956] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:11 2022] DELETE /identity/v3/projects/80b3d9a601134f9991a31f9fae6d0be0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:11.832971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444ab5-1eb2-49d0-89c4-37da4ee0903c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:11.832971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444ab5-1eb2-49d0-89c4-37da4ee0903c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:11.832971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab444ab5-1eb2-49d0-89c4-37da4ee0903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:11.841495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cd8c0-ddab-4307-92a9-873c1de37fa0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:11.886720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ab444ab5-1eb2-49d0-89c4-37da4ee0903c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:11.889308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ab444ab5-1eb2-49d0-89c4-37da4ee0903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:11.938601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:11.954535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:11.955317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:11.955601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:11.955945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] PATH_INFO: `/v3/projects/7d5f193b9c1449c8a53600c43f100fa9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:11.957603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5f193b9c1449c8a53600c43f100fa9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:11.960973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.041288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5f193b9c1449c8a53600c43f100fa9', 'request_id': 'req-64dc2013-198d-414a-9f61-134f84fb3ce5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:12.048519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5f193b9c1449c8a53600c43f100fa9', 'request_id': 'req-64dc2013-198d-414a-9f61-134f84fb3ce5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:12.052547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 979/1957] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:12.062635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.062956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.063216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.071656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5f193b9c1449c8a53600c43f100fa9', 'request_id': 'req-64dc2013-198d-414a-9f61-134f84fb3ce5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:12.110317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] The token cache is being invalidate because project 7d5f193b9c1449c8a53600c43f100fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:12.110317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:12.110317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64dc2013-198d-414a-9f61-134f84fb3ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:12.110317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 979/1958] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:11 2022] DELETE /identity/v3/projects/7d5f193b9c1449c8a53600c43f100fa9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:12.114437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85da2-e7b4-4f53-a8f8-563058941f27 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.114751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85da2-e7b4-4f53-a8f8-563058941f27 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.115044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85da2-e7b4-4f53-a8f8-563058941f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.121395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:12.123150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:12.139087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-15c85da2-e7b4-4f53-a8f8-563058941f27 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:12.140478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-15c85da2-e7b4-4f53-a8f8-563058941f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:12.286825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 980/1959] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:12.287408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.294013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 980/1960] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:12.298789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7ffb-12db-41e1-96cf-fe7ed6ccea31 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.306253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.306932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.307316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.315779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.315779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.315779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.316126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.329673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:12.330408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.333701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.334182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:12.335646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:12.352684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 981/1961] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:12.355560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.364079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 981/1962] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:12.365687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.370602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87b285-fd1e-416e-a8e1-25fa42f064fa None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.376670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.377357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.377851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.378647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.379382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de5e5d-3224-410d-9266-4467a64c833c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.379521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:12.379831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.381622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.384450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.385065 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.385351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.385793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.386437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.388377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.400822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 982/1963] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:12.402219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.406936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:12.454390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 982/1964] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:12.463468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.519301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dde4a-e398-43cd-9c95-722b61026174 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.537070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:12.552064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffe5c4-a7ef-4525-a780-2585f915bbef admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.558825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.559867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.560424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.561639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.563157 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.566629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.584086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:12.588208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.590362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.590362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.590362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.591891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:12.612229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 983/1965] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:12.612229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.666221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.668185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.681829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 983/1966] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:12.682885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.697994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239535f-ceb3-4ca9-ae86-d107f8aeac97 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.699005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30221bc-48e0-4a49-a070-88a48b5c224f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.704428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.704934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.705315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.705593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.706330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.709203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.728066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.728709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.729025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.729304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.729944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.731972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.776307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 984/1967] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:12.779776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 984/1968] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:12 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:12.780074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.783359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.802687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7441d-7739-44ad-81f7-772baef46996 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.807804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf74a-0b38-4ca5-9998-55d89b859d43 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.817985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.819199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.819486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.819788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.820196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.820447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.821128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.822279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.822398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.822747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.824563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.827626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.840044 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 985/1969] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:12.841249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.853134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 985/1970] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:12.853254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02183fb1-f864-4739-b136-1cc0c29a8b2b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.854400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.860724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.861601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.861889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.862223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.862974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.864798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.878572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc120f0-5487-4b45-ba1d-4245d924ed7c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.882927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 986/1971] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:12.884306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.895739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.896394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.896807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.897088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.897869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.899696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:12.912223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c128b-3d53-4ab9-95db-8f97df5a84be admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.924842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.925574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.925864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.929619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 986/1972] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:12.930036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] PATH_INFO: `/v3/projects/5b0ba055bfcb4c118badeac631651109/users/c808b405d5ec4905a65a9706ec8ebeda/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.930729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:12.954520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3791f0-d15e-4846-b8d3-194b6a8f7f79 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:12.969367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:12.970114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:12.970400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:12.970692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] PATH_INFO: `/v3/projects/a00451e37ce94e1a93be621e927d7628/users/e3e16866c8dc45a5b56981b01f09392a/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:12.972077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0ba055bfcb4c118badeac631651109, user_id=c808b405d5ec4905a65a9706ec8ebeda, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:12.978130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec724a76-fed6-4d87-a941-dc48197a2918 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.005514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00451e37ce94e1a93be621e927d7628, user_id=e3e16866c8dc45a5b56981b01f09392a, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.008544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4a019-9e8e-41b5-8a8e-59ce855445a9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.014846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 987/1973] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:12 2022] PUT /identity/v3/projects/5b0ba055bfcb4c118badeac631651109/users/c808b405d5ec4905a65a9706ec8ebeda/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:13.020785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.020785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.021043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.042941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 987/1974] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:12 2022] PUT /identity/v3/projects/a00451e37ce94e1a93be621e927d7628/users/e3e16866c8dc45a5b56981b01f09392a/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:13.047247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.047537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.047813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.072838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:13.075052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:13.106738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] MFA Rules not processed for user `e3e16866c8dc45a5b56981b01f09392a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:13.108154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:13.217630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 988/1975] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:13.225272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.226841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:13.258833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:13.269803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 988/1976] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:13.271276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.281625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:13.286163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff668d99-5d63-4a5d-81e7-fdf5cee99bb7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.291047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.291849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.292140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.292421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.293063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.295007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.311816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608139-cbf6-4a90-bf35-3e0ab4a094cc None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.317683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.318386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.318795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.319214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.331856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.332629 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 989/1977] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:13.333720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.340601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.346477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 989/1978] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:13.432150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1887b-9711-46d4-9d04-8ade0e380f43 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.448086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.450147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.450505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.451005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.451891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.454948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.496840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 990/1979] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:13 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:13.501881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.518261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f8f1-9964-4fdb-aeb8-e68082c34b02 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.527986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.529350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.531838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.532499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.534863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.537655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.565089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 990/1980] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:13.568968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.595470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e632-eaaa-4459-a30a-a787e4fe0156 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.611008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.611748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.611978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.612252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] PATH_INFO: `/v3/projects/f0f3993dae034fc9a0a321ff840673fa/users/d9a6b8d118054609b607542cbe93cc49/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.674056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f3993dae034fc9a0a321ff840673fa, user_id=d9a6b8d118054609b607542cbe93cc49, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.676775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.701894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 991/1981] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:13 2022] PUT /identity/v3/projects/f0f3993dae034fc9a0a321ff840673fa/users/d9a6b8d118054609b607542cbe93cc49/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:13.706053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.724850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbcb73-818c-44b8-a956-7c97c5b376d1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.779262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.781777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:13.865434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff0f86-6a94-4331-b42d-0d3627c1642f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.870289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.870575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.870868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.871161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.873866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:13.881597 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.882252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.883374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.883504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.884148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.885774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.911449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 991/1982] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:13.912664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:13.934649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98d0f-cec3-414a-94ca-dad582e5d935 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:13.943480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:13.944002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.944289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:13.944569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] PATH_INFO: `/v3/projects/f0f3993dae034fc9a0a321ff840673fa/users/d9a6b8d118054609b607542cbe93cc49/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:13.947175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f3993dae034fc9a0a321ff840673fa, user_id=d9a6b8d118054609b607542cbe93cc49, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.950415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52b65-ca41-4be3-84b0-26fb27f8e425 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.970774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:13.986808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 992/1983] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:13 2022] PUT /identity/v3/projects/f0f3993dae034fc9a0a321ff840673fa/users/d9a6b8d118054609b607542cbe93cc49/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:13.987732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:13.987732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:13.994229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827971a-279b-4d6e-96d8-9c6730372692 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:13.994521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827971a-279b-4d6e-96d8-9c6730372692 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.003224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827971a-279b-4d6e-96d8-9c6730372692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.025093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 992/1984] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:14.069851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9827971a-279b-4d6e-96d8-9c6730372692 None None] MFA Rules not processed for user `d9a6b8d118054609b607542cbe93cc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:14.071346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9827971a-279b-4d6e-96d8-9c6730372692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:14.174121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 993/1985] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:14.189843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:14.200088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e54db-4ad0-4cdc-b227-84b6140c1814 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:14.278466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:14.278704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:14.278996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.279271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.369753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:14.370051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.370333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.393175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:14.394992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:14.408982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 993/1986] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:14.429719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] MFA Rules not processed for user `c808b405d5ec4905a65a9706ec8ebeda`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:14.431838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:14.469776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:14.588115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 994/1987] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:14.590482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:14.722784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f0b8f-b1d4-46a4-ac24-386791c68c37 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:14.727805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:14.728438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:14.728723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.729090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.729818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:14.731784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:14.784792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 994/1988] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:14 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:14.785076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:14.803771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea505d74-6b16-4e27-a0bc-2c9f0cd221d4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:14.885732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:14.887164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:14.887462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.887740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.888415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:14.891236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:14.934441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 995/1989] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:14 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:14.936011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:14.948211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601072e-7359-4284-8264-aad0376acd87 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:14.963472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:14.964217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:14.965216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:14.965597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:14.966483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:14.969101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:14.998128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 995/1990] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:14.999501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:15.012287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dff8-bf89-4f87-a6ef-ea0cd4f1ba92 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:15.024409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:15.025100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:15.026188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:15.026301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] PATH_INFO: `/v3/projects/05a37ffe7ca14a739f40db2dac8862b8/users/03cdea3fd96546ca8a37caf14c028ffb/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:15.063320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a37ffe7ca14a739f40db2dac8862b8, user_id=03cdea3fd96546ca8a37caf14c028ffb, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:15.063320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:15.078689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 996/1991] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:14 2022] PUT /identity/v3/projects/05a37ffe7ca14a739f40db2dac8862b8/users/03cdea3fd96546ca8a37caf14c028ffb/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:15.083364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:15.103435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be4fdf-0afc-420c-8dd3-d500680284eb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:15.142617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:15.223655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:15.224555 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:15.225050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:15.226211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:15.227998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:15.230049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90007-0520-479d-bf7e-d9a6d656fe4f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:15.246594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 996/1992] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:15.247623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:15.275159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b022bc-ee71-45bc-8f58-3fbf969fd349 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:15.280785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:15.282161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:15.282276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:15.282609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] PATH_INFO: `/v3/projects/05a37ffe7ca14a739f40db2dac8862b8/users/03cdea3fd96546ca8a37caf14c028ffb/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:15.287495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a37ffe7ca14a739f40db2dac8862b8, user_id=03cdea3fd96546ca8a37caf14c028ffb, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:15.290173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2497-506f-40d9-8a24-0f441c331f6e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:15.316752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 997/1993] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:15 2022] PUT /identity/v3/projects/05a37ffe7ca14a739f40db2dac8862b8/users/03cdea3fd96546ca8a37caf14c028ffb/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:16.556221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:16.557161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:16.557449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:16.619589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] MFA Rules not processed for user `03cdea3fd96546ca8a37caf14c028ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:16.620841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:16.783363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 997/1994] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:16.794027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:16.794568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:16.794706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:16.846522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] MFA Rules not processed for user `c808b405d5ec4905a65a9706ec8ebeda`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:16.847821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:16.961614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 998/1995] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:16.975491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:16.977479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:17.104817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2bbf4-8599-4b19-b94e-e358ead44868 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:17.115910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:17.117300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:17.117817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:17.118294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:17.131337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:17.133064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad582e42-b630-48db-bbc6-dd01153864ae service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:17.146169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 998/1996] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:18.376637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:18.378284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:18.403601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:18.485848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2420e8-5cb5-4611-862c-d1a8dce17ecb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:18.492140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:18.492704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:18.493805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:18.494088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] PATH_INFO: `/v3/users/2053da1e91ef44609e183302e8825513` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:18.495362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2053da1e91ef44609e183302e8825513)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:18.497282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:18.555450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2053da1e91ef44609e183302e8825513'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:18.564079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2053da1e91ef44609e183302e8825513'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:18.564997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2053da1e91ef44609e183302e8825513'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:18.565806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2053da1e91ef44609e183302e8825513'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:18.575596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2053da1e91ef44609e183302e8825513'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:18.599043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 999/1997] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:18 2022] DELETE /identity/v3/users/2053da1e91ef44609e183302e8825513 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:18.603691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948d38-eee5-4281-a237-60a0395508eb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:18.604245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948d38-eee5-4281-a237-60a0395508eb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:18.604534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948d38-eee5-4281-a237-60a0395508eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:18.632616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-07948d38-eee5-4281-a237-60a0395508eb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:18.633875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-07948d38-eee5-4281-a237-60a0395508eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:18.658988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:18.707814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 999/1998] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:18.718129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:18.719568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:18.784965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af603dc-02f1-4af9-9faa-bb5202748042 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:18.791175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:18.791823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:18.792107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:18.792389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:18.815284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:18.818540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:18.833406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1000/1999] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:19.452822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07948d38-eee5-4281-a237-60a0395508eb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:19.454435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-07948d38-eee5-4281-a237-60a0395508eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:19.571817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07948d38-eee5-4281-a237-60a0395508eb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:19.575625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:19.577082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:19.577375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:19.577679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:19.579860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:19.679395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:19.681923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:19.695928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1000/2000] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:19.972232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:19.975131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:19.996221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dcdd1-79a1-4772-a937-13296a075b75 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:20.003271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:20.004609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:20.005115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:20.005653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] PATH_INFO: `/v3/projects/3426128b6cf94530a768941fb77c9700` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:20.007936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3426128b6cf94530a768941fb77c9700)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:20.011689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:20.085500 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:20.099011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3426128b6cf94530a768941fb77c9700', 'request_id': 'req-50ea0afa-4eb5-47f1-8f50-1114db1e5114'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.111376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3426128b6cf94530a768941fb77c9700', 'request_id': 'req-50ea0afa-4eb5-47f1-8f50-1114db1e5114'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.123338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3426128b6cf94530a768941fb77c9700', 'request_id': 'req-50ea0afa-4eb5-47f1-8f50-1114db1e5114'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.137009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] The token cache is being invalidate because project 3426128b6cf94530a768941fb77c9700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:20.137422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.138206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.146208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1001/2001] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:19 2022] DELETE /identity/v3/projects/3426128b6cf94530a768941fb77c9700 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:20.146490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:20.157930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f4f5-dcd4-4603-b61b-799fcc53a60a service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:20.242251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:20.243124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:20.243412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:20.243735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] PATH_INFO: `/v3/users/97e9b19f50e34de1a6ee37a44140f77b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:20.244882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e9b19f50e34de1a6ee37a44140f77b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:20.246976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:20.273511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:20.302265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e9b19f50e34de1a6ee37a44140f77b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.311128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e9b19f50e34de1a6ee37a44140f77b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.312314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e9b19f50e34de1a6ee37a44140f77b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.312978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e9b19f50e34de1a6ee37a44140f77b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.321001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e9b19f50e34de1a6ee37a44140f77b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.340956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1001/2002] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:20 2022] DELETE /identity/v3/users/97e9b19f50e34de1a6ee37a44140f77b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:20.700381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:20.704278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:20.740004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0afa-4eb5-47f1-8f50-1114db1e5114 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:20.831309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:20.832227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:20.834129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:20.835130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] PATH_INFO: `/v3/projects/bbb51a517df140ce9139ef79d53237ab` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:20.839771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb51a517df140ce9139ef79d53237ab)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:20.848904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:20.940801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb51a517df140ce9139ef79d53237ab', 'request_id': 'req-77e5b937-a20c-4af0-82e9-ddb59e652a92'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.947960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb51a517df140ce9139ef79d53237ab', 'request_id': 'req-77e5b937-a20c-4af0-82e9-ddb59e652a92'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.958739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb51a517df140ce9139ef79d53237ab', 'request_id': 'req-77e5b937-a20c-4af0-82e9-ddb59e652a92'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.976362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] The token cache is being invalidate because project bbb51a517df140ce9139ef79d53237ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:20.976959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.977446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:20.979456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1002/2003] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:20 2022] DELETE /identity/v3/projects/bbb51a517df140ce9139ef79d53237ab => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:20.984562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:20.991551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:21.021656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9453c-f8aa-47a8-b7cc-3af3df5a76fc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:21.109866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:21.112496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:21.113875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:21.114322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] PATH_INFO: `/v3/users/4b540df5abaa4f8e8c25b75b42f2c4ae` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:21.116394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b540df5abaa4f8e8c25b75b42f2c4ae)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:21.119702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:21.174240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b540df5abaa4f8e8c25b75b42f2c4ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.183083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b540df5abaa4f8e8c25b75b42f2c4ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.184539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b540df5abaa4f8e8c25b75b42f2c4ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.185256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b540df5abaa4f8e8c25b75b42f2c4ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.199692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-4f3cd055-d892-474a-a33c-08d52d45823f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b540df5abaa4f8e8c25b75b42f2c4ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.221188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1002/2004] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:20 2022] DELETE /identity/v3/users/4b540df5abaa4f8e8c25b75b42f2c4ae => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:21.726635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:21.728424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:21.745355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5b937-a20c-4af0-82e9-ddb59e652a92 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:21.828464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:21.837261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:21.838451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:21.838781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:21.839411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] PATH_INFO: `/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:21.840961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d6ac7c968049cba1b7b4cd2abc7a6e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:21.844013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:21.901207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d6ac7c968049cba1b7b4cd2abc7a6e', 'request_id': 'req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.911585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d6ac7c968049cba1b7b4cd2abc7a6e', 'request_id': 'req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.920640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d6ac7c968049cba1b7b4cd2abc7a6e', 'request_id': 'req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.941219 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] The token cache is being invalidate because project 04d6ac7c968049cba1b7b4cd2abc7a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:21.941558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.942190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8ba8f8a8-8986-4cd7-94b8-7ec784332f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:21.944087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1003/2005] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:21 2022] DELETE /identity/v3/projects/04d6ac7c968049cba1b7b4cd2abc7a6e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:21.948881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:21.949175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:21.949458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:21.973863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:21.975414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:21.986473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:22.049484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1003/2006] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:22.057054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.057553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.057648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.079637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:22.080847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:22.089134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1004/2007] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:22.094178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.103890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb8d2d-d077-4d2a-b632-b6cba5980089 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.109065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.109675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.109956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.110259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.110946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:22.111249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.112886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.125522 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1004/2008] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:22.129923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.139957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5569217-ab14-40c9-a976-21c94fc96a2f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.145242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.145864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.146150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.146481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.147372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.149111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.185257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1005/2009] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:22 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:22.189696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.206180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a295f-0b5e-475f-830d-96198bf02612 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.285433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.286309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.286882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.287306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.288102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.290679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.318758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1005/2010] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:22 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:22.323120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.335620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98e57c-be28-4da7-8e0e-def004c96a2c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.345031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.345927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.346217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.346521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.347213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.348825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.364404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1006/2011] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:22.371512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.383632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5e6b0-ad0a-4757-9552-b91193320f90 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.388952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.389573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.389850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.390164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.392334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.392907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a576a-05e5-44d5-802b-30eba0206c9c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.409439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1006/2012] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:22.409714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.434257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d75c-5aba-487d-8eca-f7cc510ba1f5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.439886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.440810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.441098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.441377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] PATH_INFO: `/v3/projects/078038df706a4169aa24b7984573933d/users/7ea213ad4920461abd201123a19290fa/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.474246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078038df706a4169aa24b7984573933d, user_id=7ea213ad4920461abd201123a19290fa, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.477263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.502744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1007/2013] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:22 2022] PUT /identity/v3/projects/078038df706a4169aa24b7984573933d/users/7ea213ad4920461abd201123a19290fa/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:22.510200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.510878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.511182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.585483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] MFA Rules not processed for user `7ea213ad4920461abd201123a19290fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:22.588473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:22.674675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1007/2014] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:22.692356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:22.694562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:22.771370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea82e9a-c929-4a34-bd30-cbc4d46702e6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:22.775095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:22.775725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:22.775989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:22.776265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:22.787072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:22.788505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e6f69-8c3f-4b6e-8d63-7c8843bfc0ce service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:22.798084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1008/2015] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:24.985314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:24.987809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:25.012500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:25.100827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62602-5bf5-4047-bcf5-6ca9b5a6e95b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:25.126441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:25.127174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:25.127455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:25.127780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] PATH_INFO: `/v3/users/e3e16866c8dc45a5b56981b01f09392a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:25.129097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e16866c8dc45a5b56981b01f09392a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:25.131290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:25.204132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e16866c8dc45a5b56981b01f09392a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.215147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e16866c8dc45a5b56981b01f09392a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.215849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e16866c8dc45a5b56981b01f09392a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.216643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e16866c8dc45a5b56981b01f09392a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.226323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e16866c8dc45a5b56981b01f09392a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.254260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1008/2016] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:24 2022] DELETE /identity/v3/users/e3e16866c8dc45a5b56981b01f09392a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:25.259198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:25.260127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:25.260519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:25.297548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:25.298971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:25.320395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:25.371962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1009/2017] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:25.382735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:25.384321 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:25.454626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389a56-a1e5-46af-ba0e-238246f7e295 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:25.458029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:25.458854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:25.459240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:25.459636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:25.470899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:25.472751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:25.485786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1009/2018] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:25.860747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:25.863347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:25.885416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546759e0-be4f-4341-a4b2-8a445b64c4db None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:25.900086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:25.901588 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:25.901825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:25.902175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] PATH_INFO: `/v3/projects/a00451e37ce94e1a93be621e927d7628` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:25.903482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00451e37ce94e1a93be621e927d7628)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:25.906889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:25.977361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00451e37ce94e1a93be621e927d7628', 'request_id': 'req-c262bc12-d5f2-45c1-a375-f791061e0692'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:25.989277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00451e37ce94e1a93be621e927d7628', 'request_id': 'req-c262bc12-d5f2-45c1-a375-f791061e0692'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.000845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00451e37ce94e1a93be621e927d7628', 'request_id': 'req-c262bc12-d5f2-45c1-a375-f791061e0692'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.015748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] The token cache is being invalidate because project a00451e37ce94e1a93be621e927d7628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:26.016501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.017541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.022986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1010/2019] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:25 2022] DELETE /identity/v3/projects/a00451e37ce94e1a93be621e927d7628 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:26.024052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:26.037773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ed89-ee0e-4860-a3fb-9f89feae9f0e service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:26.104606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:26.165185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:26.166162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:26.166588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:26.167039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] PATH_INFO: `/v3/users/d9a6b8d118054609b607542cbe93cc49` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:26.168284 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a6b8d118054609b607542cbe93cc49)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:26.171426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:26.272437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a6b8d118054609b607542cbe93cc49'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.283472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a6b8d118054609b607542cbe93cc49'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.284504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a6b8d118054609b607542cbe93cc49'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.285372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a6b8d118054609b607542cbe93cc49'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.307424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e676b5ac-7736-488b-b1d4-405619a75602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a6b8d118054609b607542cbe93cc49'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.341066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1010/2020] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:26 2022] DELETE /identity/v3/users/d9a6b8d118054609b607542cbe93cc49 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:26.824032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:26.826119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:26.840523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262bc12-d5f2-45c1-a375-f791061e0692 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:26.917625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:26.918306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:26.918594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:26.918932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] PATH_INFO: `/v3/projects/f0f3993dae034fc9a0a321ff840673fa` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:26.920771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f3993dae034fc9a0a321ff840673fa)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:26.922768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:26.984512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f3993dae034fc9a0a321ff840673fa', 'request_id': 'req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:26.986457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:26.996969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f3993dae034fc9a0a321ff840673fa', 'request_id': 'req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:27.009404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f3993dae034fc9a0a321ff840673fa', 'request_id': 'req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:27.021731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] The token cache is being invalidate because project f0f3993dae034fc9a0a321ff840673fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:27.022023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:27.022693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2202a6d-3a6d-4d3e-9a6b-1bf1324d91fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:27.024418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1011/2021] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:26 2022] DELETE /identity/v3/projects/f0f3993dae034fc9a0a321ff840673fa => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:27.030603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.031103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.031195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.051257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:27.052467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:27.118446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1011/2022] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:27.127093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.127384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.127671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.147484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:27.148697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:27.158926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1012/2023] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:27.163611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.182246 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430fc2-b663-49d7-b20e-ac3155dc4b39 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.187967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.188753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.189050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.189626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.190465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:27.190831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.192739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.220392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1012/2024] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:27.221557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.239637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a531b2-f3bc-42ce-a3f4-d474a9cef240 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.255033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.255959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.256494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.256969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.258108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.261411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.313568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.321156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1013/2025] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:27.326976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddce7-6235-4d5e-89c2-9fde7d863b3c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.414276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:27.446953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.447450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.447732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.448005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.448641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.452860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.501840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.506986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1013/2026] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:27.515198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d61cca-1ac1-4cf2-9858-051f8e2111f1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.533898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.534830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.535119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.535510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.536174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.537967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.568723 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1014/2027] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:27.593427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.613613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2706fb5-37c7-4bd4-adb3-6b690dd3cec4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.618761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.619386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.619665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.620035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.620995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.622700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a88b7-7ed8-45bc-96c3-f011028478d1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.636420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1014/2028] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:27.641886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.655507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ee46a-5a13-4992-a78c-3573ab6af4a7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:27.664092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:27.665462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.667072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.667359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] PATH_INFO: `/v3/projects/21309477e79e40178253d69dfbb71746/users/37adcd1417c0416d9ccfa34db3e9802c/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.691504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21309477e79e40178253d69dfbb71746, user_id=37adcd1417c0416d9ccfa34db3e9802c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:27.696607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc4065-02dd-4646-bb81-91c96567e7dc admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:27.725470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1015/2029] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:27 2022] PUT /identity/v3/projects/21309477e79e40178253d69dfbb71746/users/37adcd1417c0416d9ccfa34db3e9802c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:27.742170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.742492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.743411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.779644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ee2e-ca24-4db5-89cf-85ba83794a08 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.779934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ee2e-ca24-4db5-89cf-85ba83794a08 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.780370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54ee2e-ca24-4db5-89cf-85ba83794a08 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.781937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1016/2030] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:07:27.783178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] MFA Rules not processed for user `37adcd1417c0416d9ccfa34db3e9802c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:27.785152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:27.822534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:27.822922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:27.823277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:27.885929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:27.887485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:27.930134 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1015/2031] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:27.932036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:27.934583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.016324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1017/2032] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:07:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:28.017420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.020543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.051752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad101-7acf-4dd3-99cf-715b4a024b3e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.057101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.057842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.058222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.058600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] PATH_INFO: `/v3/users/ebb6142f6a3f41e4af6f109b31dfc9a7` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.060542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb6142f6a3f41e4af6f109b31dfc9a7)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.062637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.091067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9153-8863-41f4-ae75-6c541092c8c8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.093460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.094104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.094472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.094736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.107369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.109104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.118099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb6142f6a3f41e4af6f109b31dfc9a7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.119340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1018/2033] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:28.120081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.121288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:28.121909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.129124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb6142f6a3f41e4af6f109b31dfc9a7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.130207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb6142f6a3f41e4af6f109b31dfc9a7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.132477 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb6142f6a3f41e4af6f109b31dfc9a7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.142924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb6142f6a3f41e4af6f109b31dfc9a7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.149579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf1c9-7d39-4240-8a29-f2e8a9163edb service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.156272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.157013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.157361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.157638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.159639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.163663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1016/2034] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:27 2022] DELETE /identity/v3/users/ebb6142f6a3f41e4af6f109b31dfc9a7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:28.167853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.169567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.176141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.178105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e03fc-159b-4082-b8a7-8d5ac9df9632 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.184955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:28.191224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1019/2035] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:28.265568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a867b4-88b0-4341-ae15-493aca6c3fcd admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.271306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.272018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.272373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.272719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] PATH_INFO: `/v3/users/37adcd1417c0416d9ccfa34db3e9802c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.273962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37adcd1417c0416d9ccfa34db3e9802c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.276489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.339025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37adcd1417c0416d9ccfa34db3e9802c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.347567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37adcd1417c0416d9ccfa34db3e9802c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.348227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37adcd1417c0416d9ccfa34db3e9802c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.348875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37adcd1417c0416d9ccfa34db3e9802c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.357799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37adcd1417c0416d9ccfa34db3e9802c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.376699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1017/2036] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:28 2022] DELETE /identity/v3/users/37adcd1417c0416d9ccfa34db3e9802c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:28.381135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.381426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.381703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.407680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.408816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:28.409114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.410826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.495223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:28.520340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1020/2037] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:28.523012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f4457-6254-4ea7-8e78-ad57ff6fc4bc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.531611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.531811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.532264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.532748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.533034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] PATH_INFO: `/v3/projects/6434fcff873348b8b0aff8633dcd1feb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.533577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.534182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6434fcff873348b8b0aff8633dcd1feb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.536141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.609308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebe377-af40-41c2-9ffc-6df147b933cf None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.612165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6434fcff873348b8b0aff8633dcd1feb', 'request_id': 'req-ab0d78ba-9ecf-4807-b890-2af14cd5720b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.619035 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6434fcff873348b8b0aff8633dcd1feb', 'request_id': 'req-ab0d78ba-9ecf-4807-b890-2af14cd5720b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.632600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6434fcff873348b8b0aff8633dcd1feb', 'request_id': 'req-ab0d78ba-9ecf-4807-b890-2af14cd5720b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.646190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] The token cache is being invalidate because project 6434fcff873348b8b0aff8633dcd1feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:28.646494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.647804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ab0d78ba-9ecf-4807-b890-2af14cd5720b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:28.653038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1018/2038] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:28 2022] DELETE /identity/v3/projects/6434fcff873348b8b0aff8633dcd1feb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:28.654910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3572-ff5b-4e42-9358-d6fbf73444b9 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.655314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3572-ff5b-4e42-9358-d6fbf73444b9 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.655664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3572-ff5b-4e42-9358-d6fbf73444b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.672009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.672704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.672980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.673165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.674913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.676984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-62ea3572-ff5b-4e42-9358-d6fbf73444b9 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:28.678165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-62ea3572-ff5b-4e42-9358-d6fbf73444b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.744132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1019/2039] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:28.751506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.752637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.752931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.753208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.753312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.766153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1021/2040] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:28.775065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:28.776310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:28.789935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1020/2041] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:28.790031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.799938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f2917-8c78-4cfd-9c81-237c79d6f525 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.804925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.805541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.805826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.806106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.806798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:28.807109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.808714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.811084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:28.823454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1022/2042] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:28.827916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.839013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10758a-ee0f-4a18-9cb5-c431b9a0f6b7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.845521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.846068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.846464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.847242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.847677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.849826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:28.887997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1021/2043] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:28 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:28.889536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:28.905615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454e8ce-1b78-4332-a8a1-2c236f95cc82 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:28.990457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:28.991137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:28.991411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:28.991685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:28.992395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:28.994346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.029927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1023/2044] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:28 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:29.030622 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.046930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e294a4-e552-4f64-80aa-a7b52d13bd39 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.063293 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.064057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.064407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.064748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.065505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.067344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.087237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1022/2045] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.090705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.104166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfa6e3-099c-4913-8d01-8927f5402ea4 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.111540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.112263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.112549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.112824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.113496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.116387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.147976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1024/2046] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.149489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.149717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.151537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:29.165434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb93d6-3306-4ae5-87e4-5fa05fc23fed admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.171961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.172818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.173111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.173394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] PATH_INFO: `/v3/projects/35f6848b136140edb3515ff6edaebbb1/users/08127164ba4c4b679156c5354ed59e81/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.192008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11049d44-69a9-432e-8737-f2e69ef87218 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.198472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f6848b136140edb3515ff6edaebbb1, user_id=08127164ba4c4b679156c5354ed59e81, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.203263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ef5e8-c315-4bf7-9653-bcd0e2e8932b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.204631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.205850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.206263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.206518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] PATH_INFO: `/v3/projects/21309477e79e40178253d69dfbb71746` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.217239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=21309477e79e40178253d69dfbb71746)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.219873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1023/2047] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:29 2022] PUT /identity/v3/projects/35f6848b136140edb3515ff6edaebbb1/users/08127164ba4c4b679156c5354ed59e81/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:29.229011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.230452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.230849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.231129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.260120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:29.266182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] MFA Rules not processed for user `08127164ba4c4b679156c5354ed59e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:29.268818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:29.325105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21309477e79e40178253d69dfbb71746', 'request_id': 'req-577c125c-fd20-45e9-b7c8-744110a220ff'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:29.335001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21309477e79e40178253d69dfbb71746', 'request_id': 'req-577c125c-fd20-45e9-b7c8-744110a220ff'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:29.345580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21309477e79e40178253d69dfbb71746', 'request_id': 'req-577c125c-fd20-45e9-b7c8-744110a220ff'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:29.360615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] The token cache is being invalidate because project 21309477e79e40178253d69dfbb71746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:29.360802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:29.361482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-577c125c-fd20-45e9-b7c8-744110a220ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:29.363456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1025/2048] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:29 2022] DELETE /identity/v3/projects/21309477e79e40178253d69dfbb71746 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:29.367891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269381-29f4-4c94-bf7c-a1858d1cd71f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.368180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269381-29f4-4c94-bf7c-a1858d1cd71f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.368456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11269381-29f4-4c94-bf7c-a1858d1cd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.391632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-11269381-29f4-4c94-bf7c-a1858d1cd71f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:29.393115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-11269381-29f4-4c94-bf7c-a1858d1cd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:29.408217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1024/2049] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:29.409432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.410813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:29.449329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:29.471921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1026/2050] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:29.473584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.473876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.474162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.496747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:29.498868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:29.501308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bcc3-03e3-45a5-8187-3236f47d2eee None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.506203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.506935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.507282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.507626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.508323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.512321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1027/2051] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:29.512566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.515188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.524815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081771fc-4f22-4bb3-96aa-1b1aec2354d3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.532001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.532641 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.532925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.533206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.533911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:29.534316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.535955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.546612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1025/2052] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:29.547411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.552535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1028/2053] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:29.556977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.568075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ce650-e758-45b2-8f16-509a546168d8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.623508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6401a-70af-48c2-b775-7cbb9e4efd89 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.631282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.632037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.632323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.632600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.633383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.635408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.635512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.636073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.636362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.636746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.637375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.639903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.666502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1026/2054] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:29.667615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.679151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc5a6-be1d-4b07-b214-9c59d4f35cdc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.686153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1029/2055] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:29.686305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.686305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.686305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.686305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.686618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.687280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.688320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.700803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1027/2056] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.704980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.715983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ef9f0-b843-4ba8-9b1f-43b28197ced5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.720917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:29.769585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a688-ac4f-4f2d-b0b2-513fa682fe8d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.775206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.775818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.776097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.776371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.776997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.779062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.781693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.782431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.782804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.783158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] PATH_INFO: `/v3/projects/140042f8251f4be1b3346d285badf24f/users/8982b00195eb4b5999d9695f9512d314/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.801207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140042f8251f4be1b3346d285badf24f, user_id=8982b00195eb4b5999d9695f9512d314, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.804022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.808390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1030/2057] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:29.809364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.818063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1028/2058] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:29 2022] PUT /identity/v3/projects/140042f8251f4be1b3346d285badf24f/users/8982b00195eb4b5999d9695f9512d314/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:29.821462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be785b-7a56-4a57-abf8-e09284d8484d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.825917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.875297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:29.888770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.889387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.889686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.890249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.890605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.892274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.903637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1031/2059] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.906557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686d900-ed66-4689-bd09-7fd79ef5ca78 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.907592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.911999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.912643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.913334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.913625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.914305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.918171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.918774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ab18f-832f-4ba7-8f57-c2354a1bb70d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.925470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.926141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.926424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.926800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.927505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.929416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.933166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1029/2060] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.934310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.945311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bec14-1460-4c00-b876-a4fb6340f74e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.946958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1032/2061] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:29.950169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:29.951346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.952042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.952319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.952593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] PATH_INFO: `/v3/projects/140042f8251f4be1b3346d285badf24f/users/8982b00195eb4b5999d9695f9512d314/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.954810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=140042f8251f4be1b3346d285badf24f, user_id=8982b00195eb4b5999d9695f9512d314, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:29.957626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657e187-0358-4534-88ab-a36a9e67405f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:29.960654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce599035-4a62-43ce-9f71-b34d5b67ae97 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:29.965797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:29.966849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.967149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.967475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] PATH_INFO: `/v3/projects/3cb76f2db31e442095072e52c0b5dc2d/users/46a86d784f304dd5ac119bea5daab51e/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:29.974105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1030/2062] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:29 2022] PUT /identity/v3/projects/140042f8251f4be1b3346d285badf24f/users/8982b00195eb4b5999d9695f9512d314/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:29.981220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:29.981508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:29.982721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:30.000884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb76f2db31e442095072e52c0b5dc2d, user_id=46a86d784f304dd5ac119bea5daab51e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:30.003975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f6f7-32cc-4764-89da-10c3971a9928 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:30.025321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1033/2063] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:29 2022] PUT /identity/v3/projects/3cb76f2db31e442095072e52c0b5dc2d/users/46a86d784f304dd5ac119bea5daab51e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:30.025511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] MFA Rules not processed for user `8982b00195eb4b5999d9695f9512d314`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:30.025511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:30.028288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:30.029538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:30.030053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:30.052683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:30.054062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:30.111054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:30.134085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1031/2064] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:30.142623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:30.143753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1034/2065] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:30.144651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:30.153409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:30.155624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:30.216033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4763-90e3-4594-8e8d-068759403656 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:30.220098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:30.220714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:30.221052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:30.221356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:30.228661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cb3c-6062-4bb9-b0a4-e05632d610d7 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:30.232438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:30.233633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:30.233907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:30.234245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:30.234531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:30.234847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:30.244446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1032/2066] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:30.245355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:30.246944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b7211-a390-420e-985c-fd33f90c0df9 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:30.257902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1035/2067] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:30.935033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:30.947710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd79401-ce21-46f6-ad45-6c2f94d592ae service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:30.954822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:30.955534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:30.955822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:30.956143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] PATH_INFO: `/v3/users/08127164ba4c4b679156c5354ed59e81` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:30.957586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08127164ba4c4b679156c5354ed59e81)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:30.959758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:31.033008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08127164ba4c4b679156c5354ed59e81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.042459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08127164ba4c4b679156c5354ed59e81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.043360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08127164ba4c4b679156c5354ed59e81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.044077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08127164ba4c4b679156c5354ed59e81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.069185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-027b59c3-09b1-4f95-8835-07b545ce9a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08127164ba4c4b679156c5354ed59e81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.099254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1033/2068] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:30 2022] DELETE /identity/v3/users/08127164ba4c4b679156c5354ed59e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:31.103077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.104534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.106871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.151520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.152051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.152311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.168015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:31.170792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:31.188780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] MFA Rules not processed for user `46a86d784f304dd5ac119bea5daab51e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:31.191734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:31.226741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:31.246470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1036/2069] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:31.254189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:31.259689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:31.279885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1034/2070] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:31.293126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:31.295397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:31.301914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:31.332292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71de47-833d-45b7-8fe9-589936c70aeb None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:31.336371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:31.337210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.337628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.337858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.348646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:31.350091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:31.361202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1037/2071] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:31.373449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ee984-4c7b-4388-84a1-91a3f3c99037 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:31.377048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:31.377666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.377939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.378208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.389239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:31.390758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:31.400516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1035/2072] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:31.649365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:31.651112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:31.681552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e735b-a1b6-4284-b4da-4e4be32c2300 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:31.696608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:31.697267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.697565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.697841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] PATH_INFO: `/v3/projects/35f6848b136140edb3515ff6edaebbb1` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.699642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f6848b136140edb3515ff6edaebbb1)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:31.702139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:31.772770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f6848b136140edb3515ff6edaebbb1', 'request_id': 'req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.782607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f6848b136140edb3515ff6edaebbb1', 'request_id': 'req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.800402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f6848b136140edb3515ff6edaebbb1', 'request_id': 'req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.813036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] The token cache is being invalidate because project 35f6848b136140edb3515ff6edaebbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:31.813372 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.814164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.817406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1038/2073] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:31 2022] DELETE /identity/v3/projects/35f6848b136140edb3515ff6edaebbb1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:31.819996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:31.832779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d6781-2171-4901-8f0d-d56a874456a3 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:31.912977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:31.913621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:31.913908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:31.914183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] PATH_INFO: `/v3/users/8982b00195eb4b5999d9695f9512d314` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:31.915341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8982b00195eb4b5999d9695f9512d314)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:31.917276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:31.965291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8982b00195eb4b5999d9695f9512d314'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.972755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8982b00195eb4b5999d9695f9512d314'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.973387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8982b00195eb4b5999d9695f9512d314'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.974045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8982b00195eb4b5999d9695f9512d314'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:31.983157 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ec884c93-38f7-428b-9a9e-677ef4fa8515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8982b00195eb4b5999d9695f9512d314'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.001423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1036/2074] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:31 2022] DELETE /identity/v3/users/8982b00195eb4b5999d9695f9512d314 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:32.290260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.291890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.307759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d3af-9d15-4370-a9f5-9c29f38a10c8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.373735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.374403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.374677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.375039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] PATH_INFO: `/v3/projects/140042f8251f4be1b3346d285badf24f` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.376308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=140042f8251f4be1b3346d285badf24f)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.378252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.406391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:32.433608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140042f8251f4be1b3346d285badf24f', 'request_id': 'req-a3cd9eae-a236-466d-8699-7469e5deee5c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.440249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140042f8251f4be1b3346d285badf24f', 'request_id': 'req-a3cd9eae-a236-466d-8699-7469e5deee5c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.449137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140042f8251f4be1b3346d285badf24f', 'request_id': 'req-a3cd9eae-a236-466d-8699-7469e5deee5c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.461678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] The token cache is being invalidate because project 140042f8251f4be1b3346d285badf24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:32.461977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.466988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:32.469176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1039/2075] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:32 2022] DELETE /identity/v3/projects/140042f8251f4be1b3346d285badf24f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:32.474413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11074e4-e6ab-43ad-8ab6-9b07b3aac227 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.474975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11074e4-e6ab-43ad-8ab6-9b07b3aac227 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.475590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11074e4-e6ab-43ad-8ab6-9b07b3aac227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.496416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d11074e4-e6ab-43ad-8ab6-9b07b3aac227 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:32.497795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d11074e4-e6ab-43ad-8ab6-9b07b3aac227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.517701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:32.545272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.546762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.563485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1037/2076] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:32.570894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.571185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.571463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.590554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:32.592327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.600572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1038/2077] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:32.604625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.604847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd9eae-a236-466d-8699-7469e5deee5c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.609085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.609700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.609981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.610260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.612061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.615071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb37828-7a92-4323-a839-d652241ec5fd None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.619912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.620599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.620888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.621175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.621858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:32.622198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.623949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.636227 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1039/2078] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:07:32.640300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.650233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aee5b-025c-4b99-b678-e3b8bc1f4741 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.655844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.656454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.656740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.657017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.657650 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.659626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.675726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.677489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.688053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1040/2080] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:32.688242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1040/2080] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:32.692420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.764445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb19c5-87dd-4f0a-8bc0-02ee678508ac admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.769852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.770490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.770836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.771141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.771817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.773784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2b28-2892-4fcd-8f23-aa639b31f442 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.801082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1041/2081] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:32.805261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.814915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca2a90-94de-42ce-af1a-478aecf18849 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.815210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca2a90-94de-42ce-af1a-478aecf18849 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.815492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca2a90-94de-42ce-af1a-478aecf18849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.818003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f7b33-15b0-4807-9932-75311eaaeba4 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.823289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.824827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.825793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.826146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.826895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.828596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.837020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-85ca2a90-94de-42ce-af1a-478aecf18849 None None] MFA Rules not processed for user `46a86d784f304dd5ac119bea5daab51e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:32.838230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-85ca2a90-94de-42ce-af1a-478aecf18849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:32.840097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1041/2082] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:32.847887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.861314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7e9a9-0619-451e-9d16-34c026e66cb1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.866109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.866752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.867039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.867316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.867961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.869584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.889078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1042/2083] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:32.894478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:32.908224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18aae34-5dd5-4c99-a90e-63322d455bd5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:32.913190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:32.913915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.914207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.914485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] PATH_INFO: `/v3/projects/abb2800f701143adbf9dd2a378d2faee/users/07b155f872be49a9832e8010300f91fc/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:32.920145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1042/2084] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:32.930543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb2800f701143adbf9dd2a378d2faee, user_id=07b155f872be49a9832e8010300f91fc, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:32.933029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:32.962720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1043/2085] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:32 2022] PUT /identity/v3/projects/abb2800f701143adbf9dd2a378d2faee/users/07b155f872be49a9832e8010300f91fc/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:32.964113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:32.964401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:32.964718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.002674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] MFA Rules not processed for user `07b155f872be49a9832e8010300f91fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:33.003499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:33.010093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:33.111913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1043/2086] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:33.119167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.151755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:33.225408 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ea1b1-45b5-49b4-be29-a22ef1a2cc78 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.232202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.232849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.233262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.233582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.235331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.237793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.280856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1044/2087] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:33 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:33.285358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.299760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8dd01-e84a-4e5d-a47c-e6bdf66b3ab4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.382616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.383346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.383708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.384057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.384803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.387106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.422969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1044/2088] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:33 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:33.424833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.448654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e6099-7b78-4324-99ff-965c9af8ba4f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.456912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.458177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.458526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.458948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.460200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.462487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.479731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1045/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:33.484569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.496367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb45e-b85a-472b-bbc4-1ce3aa62bfba admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.502874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.503862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.504399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.504886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.506118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.508783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d937083-e82f-4380-83a5-5c59e7395373 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.522702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1045/2090] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:33.525965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.538069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac305b-8a7f-421f-9996-5aacf88846a1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.543758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.545498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.545829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.546183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] PATH_INFO: `/v3/projects/5c4a43f8f92d463fb2258b15778bc774/users/753465b917fd4b118fecd0b3f75a3f03/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.563552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4a43f8f92d463fb2258b15778bc774, user_id=753465b917fd4b118fecd0b3f75a3f03, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.566427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.582709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1046/2091] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:33 2022] PUT /identity/v3/projects/5c4a43f8f92d463fb2258b15778bc774/users/753465b917fd4b118fecd0b3f75a3f03/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:33.597228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.597722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.598203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.640819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] MFA Rules not processed for user `753465b917fd4b118fecd0b3f75a3f03`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:33.642403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:33.750831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1046/2092] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:33.755952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.831236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198698-6cf7-4607-a65d-f83a73a02253 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.843610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.844533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.844999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.845435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.846694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.848874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:33.880461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1047/2093] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:33 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:33.885945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:33.898438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff95f4-eb9c-4f0e-97eb-ce5184721731 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:33.911735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:33.971268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:33.972549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:33.973059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:33.973646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:33.974462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:33.976521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.004454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1047/2094] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:33 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:34.008993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.025948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a067a-fc07-4860-a6ed-29f502b23446 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.032301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.032924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.033229 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.033499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.034340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.036025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.051191 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1048/2095] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:34.053040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.064188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bea066-c298-4e5b-bd09-ca2f96fadc99 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.069563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.070247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.070548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.070875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] PATH_INFO: `/v3/projects/1b13bf0ebb0740459125a40d5174eb97/users/15a9d581b8544a18af4c174db264b00e/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.090245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b13bf0ebb0740459125a40d5174eb97, user_id=15a9d581b8544a18af4c174db264b00e, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.093453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.110056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1048/2096] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:34 2022] PUT /identity/v3/projects/1b13bf0ebb0740459125a40d5174eb97/users/15a9d581b8544a18af4c174db264b00e/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:34.114257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.128216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f51d6-6799-4e92-a703-efef32aaa429 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.173882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:34.174828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.176541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.197038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.197655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.197941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.198222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.199419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.202957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.214627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1049/2097] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:34.219048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.232016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061160d-1b9b-414b-aad5-99fa75f84b04 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.238239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.238941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.239222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.239505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] PATH_INFO: `/v3/projects/1b13bf0ebb0740459125a40d5174eb97/users/15a9d581b8544a18af4c174db264b00e/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.241779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b13bf0ebb0740459125a40d5174eb97, user_id=15a9d581b8544a18af4c174db264b00e, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.245036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9386-4872-4dea-a7de-53de4830558d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.257652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1050/2098] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:34 2022] PUT /identity/v3/projects/1b13bf0ebb0740459125a40d5174eb97/users/15a9d581b8544a18af4c174db264b00e/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:34.258385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e76a4-8136-4b6c-a0d2-0c0d3394c151 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.269533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.269831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.270112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.302471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] MFA Rules not processed for user `15a9d581b8544a18af4c174db264b00e`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:34.303735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.327014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.328396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.328692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.328971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] PATH_INFO: `/v3/users/7ea213ad4920461abd201123a19290fa` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.330533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea213ad4920461abd201123a19290fa)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.332808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.376720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:34.393184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea213ad4920461abd201123a19290fa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:34.401382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1051/2099] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:34.401754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea213ad4920461abd201123a19290fa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:34.402402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea213ad4920461abd201123a19290fa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:34.404080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea213ad4920461abd201123a19290fa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:34.412621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6fbf5671-d3a5-4018-8b91-64145838fd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea213ad4920461abd201123a19290fa'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:34.413672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.415113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.433052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1049/2100] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:34 2022] DELETE /identity/v3/users/7ea213ad4920461abd201123a19290fa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:34.437999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.438286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.438561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.457953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:34.459205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.476992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c795a-7fb7-4c12-97b6-13946407beb0 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.523105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1050/2101] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:34.527671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.528596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.529197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.529477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.531295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.533538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.534948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.550419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:34.594571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52c6ee-3f3b-4c46-8d8b-799da39302a2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.598531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.599178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.599462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.599737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.600053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.601530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.610312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.611830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.611950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1052/2102] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:34.621878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1051/2103] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:34.657644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:34.659102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.671032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa6005-3603-445e-a61f-c7af5d411a25 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:34.674814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:34.675459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:34.675740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:34.676017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:34.677880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:34.745672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:34.748307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc01e5-3f5a-44f7-93e4-657d0282e820 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:34.758220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1053/2104] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:35.016863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.018484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:35.040517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4b7d-98b0-494f-8559-71cc5a4fd238 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.046830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.079353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.079353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.079353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] PATH_INFO: `/v3/projects/078038df706a4169aa24b7984573933d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.079353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=078038df706a4169aa24b7984573933d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.079353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.143060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:35.147775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078038df706a4169aa24b7984573933d', 'request_id': 'req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:35.157996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078038df706a4169aa24b7984573933d', 'request_id': 'req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:35.176487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078038df706a4169aa24b7984573933d', 'request_id': 'req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:35.188943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] The token cache is being invalidate because project 078038df706a4169aa24b7984573933d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:35.189319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:35.190039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d19a13c6-27a5-49ef-8a23-3b918dd82b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:35.191724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1052/2105] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:35 2022] DELETE /identity/v3/projects/078038df706a4169aa24b7984573933d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:35.197153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.197342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.197624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.219147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:35.220348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:35.283640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1054/2106] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:35.291568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.291894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.292173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.313938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:35.315232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:35.323255 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1053/2107] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:35.328079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.338195 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c0ff5-5683-485f-b3c0-7abb2e47f84f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.343409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.344011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.344298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.344572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.345237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:35.345542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.347236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.359450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1055/2108] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:07:35.363935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.373278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda407-99de-4bd7-ab92-dc1ca2cea323 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.377886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.378491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.378865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.379138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.379776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.381659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.413937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1054/2109] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:35 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:35.415108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.425287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fe8af-ae26-4a50-ac6a-da566c426be3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.466474 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:35.485557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.486224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.486511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.486854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.487590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.489614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.513128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1056/2110] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:35 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:35.517639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.530913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd1fd6-bdcf-4c95-90dd-a1852a2252db admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.536146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.536816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.537164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.537510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.538230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.540010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.553745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1055/2111] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:35.554987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.566852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb33c0-9791-437e-b7c0-a287bd1ff498 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.571714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.572334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.572616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.572888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.573557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.575793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d29915-07c6-4a83-aa93-c4a2ce723729 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.589955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1057/2112] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:35.594433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.607394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f637b5e-ab67-4d42-9d00-86a4af527634 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.612979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.613901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.614369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.614831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] PATH_INFO: `/v3/projects/81cdf15254814f2bab66cae99a43a958/users/2ed3d0dbe67c4ee7b6eb554f62834237/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.639969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cdf15254814f2bab66cae99a43a958, user_id=2ed3d0dbe67c4ee7b6eb554f62834237, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.643711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.666102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1056/2113] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:35 2022] PUT /identity/v3/projects/81cdf15254814f2bab66cae99a43a958/users/2ed3d0dbe67c4ee7b6eb554f62834237/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:35.678805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.679099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.679461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.714511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] MFA Rules not processed for user `2ed3d0dbe67c4ee7b6eb554f62834237`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:35.715957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:35.799957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1058/2114] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:35.807903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:35.810647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:35.871787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da589aa-1541-4db0-b85c-6ffcce7a504c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:35.876809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:35.877055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:35.877225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:35.877466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:35.890949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:35.894327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2662a9-ebc6-427e-88d2-d6f6a6f8f5c2 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:35.907198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1057/2115] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:37.872893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:37.874411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:37.942490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727be2e-6eda-41ac-8e8a-e16fcb269c11 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:37.947137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:37.947772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:37.948053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:37.948324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] PATH_INFO: `/v3/users/07b155f872be49a9832e8010300f91fc` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:37.949437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b155f872be49a9832e8010300f91fc)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:37.951869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:38.004979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b155f872be49a9832e8010300f91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.007585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:38.014499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b155f872be49a9832e8010300f91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.015646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b155f872be49a9832e8010300f91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.016698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b155f872be49a9832e8010300f91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.025690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b155f872be49a9832e8010300f91fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.043329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1059/2116] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:37 2022] DELETE /identity/v3/users/07b155f872be49a9832e8010300f91fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:38.048727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:38.050333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:38.050935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:38.080074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:38.081379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:38.147947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1058/2117] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:38.158534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:38.160025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:38.233050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a196-ad0f-40b8-9b37-36cc88264afc admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:38.236773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:38.237387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:38.237669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:38.237945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:38.248058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:38.249508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:38.259883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1060/2118] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:38.622526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:38.624452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:38.640976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d591162-5d5b-456f-be9f-8dcd12c5b133 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:38.647810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:38.649268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:38.649756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:38.650398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] PATH_INFO: `/v3/projects/abb2800f701143adbf9dd2a378d2faee` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:38.651941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb2800f701143adbf9dd2a378d2faee)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:38.655755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:38.668123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:38.739930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb2800f701143adbf9dd2a378d2faee', 'request_id': 'req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.750516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb2800f701143adbf9dd2a378d2faee', 'request_id': 'req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.759343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb2800f701143adbf9dd2a378d2faee', 'request_id': 'req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.773422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] The token cache is being invalidate because project abb2800f701143adbf9dd2a378d2faee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:38.773785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.774740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.776230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1059/2119] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:38 2022] DELETE /identity/v3/projects/abb2800f701143adbf9dd2a378d2faee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:38.781539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:38.793301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc25077-c08a-48dd-a1e3-648361e57237 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:38.864365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:38.865110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:38.865404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:38.865937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] PATH_INFO: `/v3/users/753465b917fd4b118fecd0b3f75a3f03` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:38.867344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753465b917fd4b118fecd0b3f75a3f03)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:38.869565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:38.925853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753465b917fd4b118fecd0b3f75a3f03'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.935061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753465b917fd4b118fecd0b3f75a3f03'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.935666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753465b917fd4b118fecd0b3f75a3f03'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.936270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753465b917fd4b118fecd0b3f75a3f03'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.943526 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753465b917fd4b118fecd0b3f75a3f03'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:38.950920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:38.963830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1061/2120] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:38 2022] DELETE /identity/v3/users/753465b917fd4b118fecd0b3f75a3f03 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:39.240487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:39.241986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:39.256932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba5cc0-1be9-44ed-9480-a096c8ef7ee5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:39.320399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:39.321064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:39.321343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:39.321611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] PATH_INFO: `/v3/projects/5c4a43f8f92d463fb2258b15778bc774` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:39.322760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4a43f8f92d463fb2258b15778bc774)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:39.324763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:39.376053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4a43f8f92d463fb2258b15778bc774', 'request_id': 'req-e943a41b-9836-49b1-8fa1-b5de19b56d9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.382400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4a43f8f92d463fb2258b15778bc774', 'request_id': 'req-e943a41b-9836-49b1-8fa1-b5de19b56d9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.390525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4a43f8f92d463fb2258b15778bc774', 'request_id': 'req-e943a41b-9836-49b1-8fa1-b5de19b56d9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.401939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] The token cache is being invalidate because project 5c4a43f8f92d463fb2258b15778bc774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:39.402230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.403661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.405594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1060/2121] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:39 2022] DELETE /identity/v3/projects/5c4a43f8f92d463fb2258b15778bc774 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:39.409407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:39.411036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:39.425127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434c1f9-8545-47a1-99be-a6e2001db2e0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:39.483209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:39.483847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:39.484151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:39.484451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] PATH_INFO: `/v3/users/15a9d581b8544a18af4c174db264b00e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:39.485561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a9d581b8544a18af4c174db264b00e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:39.487501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:39.534448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a9d581b8544a18af4c174db264b00e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.542829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a9d581b8544a18af4c174db264b00e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.543050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a9d581b8544a18af4c174db264b00e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.544439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a9d581b8544a18af4c174db264b00e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.551962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b5ae5a7-43a2-47fe-834f-d22abc394f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a9d581b8544a18af4c174db264b00e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:39.572508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1062/2122] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:39 2022] DELETE /identity/v3/users/15a9d581b8544a18af4c174db264b00e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:39.949845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:39.951596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:39.970012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943a41b-9836-49b1-8fa1-b5de19b56d9c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.017093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:40.057664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.058314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.058602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.058925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] PATH_INFO: `/v3/projects/1b13bf0ebb0740459125a40d5174eb97` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.060791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b13bf0ebb0740459125a40d5174eb97)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.062753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.120562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b13bf0ebb0740459125a40d5174eb97', 'request_id': 'req-690829c7-3110-461d-b640-9a7a8b520a81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:40.128300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b13bf0ebb0740459125a40d5174eb97', 'request_id': 'req-690829c7-3110-461d-b640-9a7a8b520a81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:40.137898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b13bf0ebb0740459125a40d5174eb97', 'request_id': 'req-690829c7-3110-461d-b640-9a7a8b520a81'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:40.150090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] The token cache is being invalidate because project 1b13bf0ebb0740459125a40d5174eb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:40.150388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:40.151382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-690829c7-3110-461d-b640-9a7a8b520a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:40.153940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1061/2123] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:39 2022] DELETE /identity/v3/projects/1b13bf0ebb0740459125a40d5174eb97 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:40.167921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.168645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.169169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.192300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:40.193765 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:40.270934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1063/2124] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:40.272855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.273354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.273443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.298887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:40.300201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:40.308730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1062/2125] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:40.314459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.324867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bac9d8-1b0a-4da6-a72a-11989e84f3e3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.329988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.330599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.331029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.331308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.332021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:40.332327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.334417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.337419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:40.351504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1064/2126] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:40.355777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.366176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0f80d-9df4-4e5d-ad3c-448f58b31de2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.371240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.372038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.372401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.372677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.373326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.375468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.404052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1063/2127] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:40.408322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.419138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423588b-80af-4782-9f32-e167b89ecdc5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.478515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.479161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.479440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.479716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.480331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.482679 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.507519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1065/2128] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:40.511904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.524724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b20f8-f55c-4f41-b67d-d3bf569498a6 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.529842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.530485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.530974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.531389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.532078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.533781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.546724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1064/2129] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:40.552369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.563622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc8be-dd46-4fd9-8343-ef0924b1c399 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.568338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.568944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.569222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.569499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.570136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.571766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6efcfb-8d67-41e4-a622-517fec4ec0ed admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.583301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1066/2130] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:40.587611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.598595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111051-3c74-46a7-9740-24ace74d5840 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.603579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.604318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.604670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.605014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] PATH_INFO: `/v3/projects/91826ed3e35d4b18b4d5f2ac7c0bcdd0/users/7761e39dd1bf45119ce20cfe5beb070e/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.620973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91826ed3e35d4b18b4d5f2ac7c0bcdd0, user_id=7761e39dd1bf45119ce20cfe5beb070e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.624302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.639070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1065/2131] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:40 2022] PUT /identity/v3/projects/91826ed3e35d4b18b4d5f2ac7c0bcdd0/users/7761e39dd1bf45119ce20cfe5beb070e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:40.650677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.650981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.651261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.680933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] MFA Rules not processed for user `7761e39dd1bf45119ce20cfe5beb070e`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:40.682310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:40.749203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1067/2132] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:40.753633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.808559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:40.819543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d74d-62f6-435c-bd6e-5101f635cb4f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.826274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.826974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.827637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.827938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.828735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.830799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.864278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1066/2133] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:40.868240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.879136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3807-3b78-46e1-b507-cad9550fa4f1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.937683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.938304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.938590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.938902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.939535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.941458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:40.952429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:40.966465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1068/2134] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:40 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:40.970561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:40.981401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbfee-c887-4e6d-987a-9541f130a0f0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:40.986230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:40.986865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:40.987142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:40.987414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:40.988054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:40.989643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.000805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1067/2135] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:41.004904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.015949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da10e1-6a70-4ca9-962b-fc901d9ad06d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.020924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.021581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.021866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.022139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] PATH_INFO: `/v3/projects/80450b9cbb5e4152948c6f243dbfd388/users/325fcc5d091249afa1329f1bc7198dcd/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.038979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80450b9cbb5e4152948c6f243dbfd388, user_id=325fcc5d091249afa1329f1bc7198dcd, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.041652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.054712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1069/2136] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:41 2022] PUT /identity/v3/projects/80450b9cbb5e4152948c6f243dbfd388/users/325fcc5d091249afa1329f1bc7198dcd/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:41.058692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.070167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ca6fc-c5ad-4e4a-979e-aac1a2ae47a0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.079369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.081211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.131696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.132359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.132653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.132932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.133600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.135297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.146120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1068/2137] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:41.150462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.150897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5463c9c-f82f-4cf0-b846-0baef63493d6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.156640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.157284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.157560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.157915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] PATH_INFO: `/v3/users/2ed3d0dbe67c4ee7b6eb554f62834237` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.159333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed3d0dbe67c4ee7b6eb554f62834237)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.161180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e7812-8e1f-48a9-a5d3-14ee50a07c03 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.161559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.166005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.166720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.167100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.167408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] PATH_INFO: `/v3/projects/80450b9cbb5e4152948c6f243dbfd388/users/325fcc5d091249afa1329f1bc7198dcd/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.171317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80450b9cbb5e4152948c6f243dbfd388, user_id=325fcc5d091249afa1329f1bc7198dcd, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.174088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7c012-a200-4c9e-9dce-c17d771cb0a4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.186425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1069/2138] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:41 2022] PUT /identity/v3/projects/80450b9cbb5e4152948c6f243dbfd388/users/325fcc5d091249afa1329f1bc7198dcd/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:41.202920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.202920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.202920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.225627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed3d0dbe67c4ee7b6eb554f62834237'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:41.234392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed3d0dbe67c4ee7b6eb554f62834237'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:41.235071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed3d0dbe67c4ee7b6eb554f62834237'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:41.235834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed3d0dbe67c4ee7b6eb554f62834237'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:41.238021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] MFA Rules not processed for user `325fcc5d091249afa1329f1bc7198dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:41.239265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.244165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7246680d-c313-4c09-b6ab-b6614fcd6a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed3d0dbe67c4ee7b6eb554f62834237'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:41.267832 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1070/2139] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:41 2022] DELETE /identity/v3/users/2ed3d0dbe67c4ee7b6eb554f62834237 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:41.272390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.273250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.273690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.298871 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:41.300211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.330097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1070/2140] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:41.344259 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.345851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.363668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:41.393963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1071/2141] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:41.401468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.404050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.412137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:41.446358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a5be-c8e6-4467-902c-1231827008ea None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.514726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.515395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.515703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.519220 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.527541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a01ba-3525-4c9c-b6c6-11837b275ed3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.533709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.534397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.534605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.534910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.558276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.560299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.572036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1072/2142] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:41.626632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.628243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.641821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1071/2143] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:41.743396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:41.783779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc9f1a-56eb-484f-9d95-fbc524f3a685 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:41.787916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:41.788538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:41.788865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:41.789093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:41.791064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:41.855926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:41.857901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:41.867785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1073/2144] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:42.036429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:42.038541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:42.062637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d806b-b1d6-4059-8f5e-875e8168daf5 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:42.075712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:42.076785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:42.077267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:42.077564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] PATH_INFO: `/v3/projects/81cdf15254814f2bab66cae99a43a958` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:42.079048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cdf15254814f2bab66cae99a43a958)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:42.081904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:42.170448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cdf15254814f2bab66cae99a43a958', 'request_id': 'req-106f31a7-b5b4-46e3-b632-3761d8f42921'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:42.178267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cdf15254814f2bab66cae99a43a958', 'request_id': 'req-106f31a7-b5b4-46e3-b632-3761d8f42921'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:42.192289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cdf15254814f2bab66cae99a43a958', 'request_id': 'req-106f31a7-b5b4-46e3-b632-3761d8f42921'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:42.208007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] The token cache is being invalidate because project 81cdf15254814f2bab66cae99a43a958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:42.208422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:42.209217 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-106f31a7-b5b4-46e3-b632-3761d8f42921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:42.214728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1072/2145] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:42 2022] DELETE /identity/v3/projects/81cdf15254814f2bab66cae99a43a958 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:46.912365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:46.914142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:46.929384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616210d-9b51-454b-9734-3fea76f0e73a service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:46.992743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:46.993418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:46.993702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:46.993989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] PATH_INFO: `/v3/users/7761e39dd1bf45119ce20cfe5beb070e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:46.995158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7761e39dd1bf45119ce20cfe5beb070e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:46.997520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:47.034786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:47.048382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7761e39dd1bf45119ce20cfe5beb070e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.055852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7761e39dd1bf45119ce20cfe5beb070e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.056497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7761e39dd1bf45119ce20cfe5beb070e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.057135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7761e39dd1bf45119ce20cfe5beb070e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.066455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7761e39dd1bf45119ce20cfe5beb070e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.089079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1074/2146] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:46 2022] DELETE /identity/v3/users/7761e39dd1bf45119ce20cfe5beb070e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:47.095164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:47.095651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:47.095770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:47.116059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:47.117271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:47.136011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:47.180651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1073/2147] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:47.190877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:47.192270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:47.252291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f041-ff5c-4814-9216-d7bf19878f9d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:47.256086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:47.256695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:47.256976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:47.257255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:47.267262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:47.268953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:47.278460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1075/2148] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:47.584740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:47.586381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:47.603135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db60e70-5ab5-473d-ae18-3499366aea53 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:47.608840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:47.609815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:47.610207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:47.610609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] PATH_INFO: `/v3/projects/91826ed3e35d4b18b4d5f2ac7c0bcdd0` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:47.612130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91826ed3e35d4b18b4d5f2ac7c0bcdd0)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:47.614435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:47.668584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91826ed3e35d4b18b4d5f2ac7c0bcdd0', 'request_id': 'req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.675066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91826ed3e35d4b18b4d5f2ac7c0bcdd0', 'request_id': 'req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.682931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91826ed3e35d4b18b4d5f2ac7c0bcdd0', 'request_id': 'req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.694613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] The token cache is being invalidate because project 91826ed3e35d4b18b4d5f2ac7c0bcdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:47.695020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.695750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.697410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1074/2149] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:47 2022] DELETE /identity/v3/projects/91826ed3e35d4b18b4d5f2ac7c0bcdd0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:47.702166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:47.712166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9526c-662b-43e2-97ad-ab390b2782cc service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:47.785753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:47.786403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:47.786716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:47.786999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] PATH_INFO: `/v3/users/325fcc5d091249afa1329f1bc7198dcd` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:47.788165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325fcc5d091249afa1329f1bc7198dcd)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:47.790091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:47.841560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325fcc5d091249afa1329f1bc7198dcd'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.849419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325fcc5d091249afa1329f1bc7198dcd'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.850172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325fcc5d091249afa1329f1bc7198dcd'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.850940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325fcc5d091249afa1329f1bc7198dcd'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.852411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:47.862121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-a36780ca-ef07-49b3-a0f0-aa3e8a6f6029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325fcc5d091249afa1329f1bc7198dcd'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:47.883189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1076/2150] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:47 2022] DELETE /identity/v3/users/325fcc5d091249afa1329f1bc7198dcd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:48.270296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.271986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:48.294570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af1ec0-cad2-46e1-b6ee-8a0a878535e5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.352132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.352796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.353084 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.353358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] PATH_INFO: `/v3/projects/80450b9cbb5e4152948c6f243dbfd388` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.354496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80450b9cbb5e4152948c6f243dbfd388)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.358007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.409088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80450b9cbb5e4152948c6f243dbfd388', 'request_id': 'req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:48.410181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:48.417779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80450b9cbb5e4152948c6f243dbfd388', 'request_id': 'req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:48.427771 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80450b9cbb5e4152948c6f243dbfd388', 'request_id': 'req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:48.440031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] The token cache is being invalidate because project 80450b9cbb5e4152948c6f243dbfd388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:48.440329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:48.440978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d78ca56f-38cc-4f55-ae1d-9c2957e41ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:48.442496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1075/2151] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:48 2022] DELETE /identity/v3/projects/80450b9cbb5e4152948c6f243dbfd388 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:48.447533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.448025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.448162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.469994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:48.471233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:48.533637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1077/2152] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:48.543750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.543750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.544106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.566969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:48.568147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:48.576723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1076/2153] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:48.581176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.591458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eff18-f1ca-4d78-a847-461523d0ae0d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.596246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.596854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.597140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.597415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.598083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:48.598393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.600051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.612088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1078/2154] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:48.616420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.626160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735e027-5aad-4771-aba7-47bdd4f799ec None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.630827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.631426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.631712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.631988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.632621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.634520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.661706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1077/2155] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:48.665790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.676704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b491e-cf8d-4ac8-b09d-8c319369997e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.733979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.734592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.734968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.735255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.735887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.737800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.764124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1079/2156] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:48.768308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.779898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c732-4738-432c-941e-77f491f9f159 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.784793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.785386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.785721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.786003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.786679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.788359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.798877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1078/2157] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:48.802893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.814113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72b83b-6c93-46ca-b6ec-bb1a3c3dd0af admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.818851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.819464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.819746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.820025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.820672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.822266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f2dbe-588f-4e41-9c08-13d66df77739 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.833850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1080/2158] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:48.837792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:48.848065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75c9e3-38d7-43be-969e-e8759506a816 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:48.853072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:48.853772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.854051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.854323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] PATH_INFO: `/v3/projects/1c74624e88fc4cba87401a22038d787c/users/b46f27a155bb4319a9fc1d8f7f061619/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.870160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c74624e88fc4cba87401a22038d787c, user_id=b46f27a155bb4319a9fc1d8f7f061619, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:48.873739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:48.887188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1079/2159] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:48 2022] PUT /identity/v3/projects/1c74624e88fc4cba87401a22038d787c/users/b46f27a155bb4319a9fc1d8f7f061619/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:48.897704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:48.897991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:48.898263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:48.926779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] MFA Rules not processed for user `b46f27a155bb4319a9fc1d8f7f061619`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:48.927969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:48.953968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:48.995244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1081/2160] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:49.000006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.064179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb546b-c777-4b7f-8d53-1280d9ab9cda admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.070699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.071311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.071594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.071868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.072520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.075070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.103088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1080/2161] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:48 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:49.107879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.119206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f1ecc-547a-45ab-954b-2f0ab2dd6536 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.179459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.180077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.180403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.180671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.181307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.183310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.207347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1082/2162] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:49 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:49.211282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.222718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77135a-910c-4727-a487-3ae26344f469 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.227520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.228131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.228412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.228684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.229326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.231237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.242764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1081/2163] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:49.247831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.258730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab81-da1b-4212-8176-f45e90685c0a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.264443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.266004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.266762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.267001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] PATH_INFO: `/v3/projects/039303f2454047bf836229c058c1bda6/users/2f28fd64fde64820b47720cb9912621a/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.284989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039303f2454047bf836229c058c1bda6, user_id=2f28fd64fde64820b47720cb9912621a, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.288135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.315523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1083/2164] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:49 2022] PUT /identity/v3/projects/039303f2454047bf836229c058c1bda6/users/2f28fd64fde64820b47720cb9912621a/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:49.319158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.331978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1ba42-3a9b-47c3-a038-30917548f758 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.394521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:49.410863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.411552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.411896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.412175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.412817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.414612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e5d6a-8457-4cf4-820d-f597d4ffdd6b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.429352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1082/2165] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:49.430542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.441612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295c10f-037c-4112-9b5e-86791ecf9355 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.446525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.447220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.447504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.447785 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] PATH_INFO: `/v3/projects/039303f2454047bf836229c058c1bda6/users/2f28fd64fde64820b47720cb9912621a/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.450397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039303f2454047bf836229c058c1bda6, user_id=2f28fd64fde64820b47720cb9912621a, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.453160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.464017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1084/2166] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:49 2022] PUT /identity/v3/projects/039303f2454047bf836229c058c1bda6/users/2f28fd64fde64820b47720cb9912621a/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:49.478607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aabc-d415-45c0-995b-45620a83458f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.478986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aabc-d415-45c0-995b-45620a83458f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.479294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005aabc-d415-45c0-995b-45620a83458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.516814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a005aabc-d415-45c0-995b-45620a83458f None None] MFA Rules not processed for user `2f28fd64fde64820b47720cb9912621a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:49.518054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a005aabc-d415-45c0-995b-45620a83458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:49.590925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1083/2167] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:49.602544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.604417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:49.668031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccb88a-d8fc-45e1-a68f-1e0e7e68e377 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.671656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.672255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.672532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.672801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.681455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.682908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.692852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1085/2168] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:49.768874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005aabc-d415-45c0-995b-45620a83458f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:49.779124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005aabc-d415-45c0-995b-45620a83458f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:49.782792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:49.783392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:49.783748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:49.784024 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:49.840632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:49.842122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52e7ba-c38a-4d59-9c4f-05b17c1a2e74 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:49.851038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1084/2169] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:50.133052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:50.159270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:50.199923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0960-6b0c-4361-bb28-a4373d90fbf7 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:50.204837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:50.205499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:50.205780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:50.206052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] PATH_INFO: `/v3/users/b46f27a155bb4319a9fc1d8f7f061619` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:50.207198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46f27a155bb4319a9fc1d8f7f061619)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:50.209108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:50.254506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46f27a155bb4319a9fc1d8f7f061619'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:50.262873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46f27a155bb4319a9fc1d8f7f061619'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:50.263495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46f27a155bb4319a9fc1d8f7f061619'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:50.264091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46f27a155bb4319a9fc1d8f7f061619'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:50.271317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46f27a155bb4319a9fc1d8f7f061619'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:50.288374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1086/2170] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:50 2022] DELETE /identity/v3/users/b46f27a155bb4319a9fc1d8f7f061619 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:50.293004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:50.293413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:50.293800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:50.313641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:50.314879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:50.374729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1085/2171] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:50.385410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:50.388198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:50.490128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1287-216c-4479-b6e0-14d7316d0c7f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:50.497708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:50.499427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:50.500016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:50.500497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:50.520690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:50.523477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:50.540116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1087/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:51.127478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:51.130073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:51.144692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4202-48b7-4fb8-b24f-f2dc97674875 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:51.163721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:51.165009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:51.165971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:51.166467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] PATH_INFO: `/v3/projects/1c74624e88fc4cba87401a22038d787c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:51.169098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c74624e88fc4cba87401a22038d787c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:51.174379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:51.179766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:51.248294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c74624e88fc4cba87401a22038d787c', 'request_id': 'req-9833781a-37a7-41cd-8f8c-fc3f3f43e977'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.256043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c74624e88fc4cba87401a22038d787c', 'request_id': 'req-9833781a-37a7-41cd-8f8c-fc3f3f43e977'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.265701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c74624e88fc4cba87401a22038d787c', 'request_id': 'req-9833781a-37a7-41cd-8f8c-fc3f3f43e977'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.278590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] The token cache is being invalidate because project 1c74624e88fc4cba87401a22038d787c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:51.278913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.279674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.281331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1086/2173] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:51 2022] DELETE /identity/v3/projects/1c74624e88fc4cba87401a22038d787c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:51.285154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:51.295767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10999c-2f08-412f-b9a8-8ce2c6eb8a48 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:51.340724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:51.360237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:51.360873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:51.361151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:51.361420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] PATH_INFO: `/v3/users/2f28fd64fde64820b47720cb9912621a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:51.362528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f28fd64fde64820b47720cb9912621a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:51.364481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:51.410226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f28fd64fde64820b47720cb9912621a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.417374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f28fd64fde64820b47720cb9912621a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.418803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f28fd64fde64820b47720cb9912621a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.419455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f28fd64fde64820b47720cb9912621a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.426360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2fe6b156-7f97-461d-a91d-87e038b0be27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f28fd64fde64820b47720cb9912621a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.444973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1088/2174] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:51 2022] DELETE /identity/v3/users/2f28fd64fde64820b47720cb9912621a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:51.720410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:51.721956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:51.737698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833781a-37a7-41cd-8f8c-fc3f3f43e977 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:51.799503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:51.800140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:51.800425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:51.800702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] PATH_INFO: `/v3/projects/039303f2454047bf836229c058c1bda6` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:51.801826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] RBAC: Authorizing `identity:delete_project(project_id=039303f2454047bf836229c058c1bda6)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:51.804521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:51.861936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039303f2454047bf836229c058c1bda6', 'request_id': 'req-d9ff751a-a42e-47d8-8039-b1f575d4347f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.868805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039303f2454047bf836229c058c1bda6', 'request_id': 'req-d9ff751a-a42e-47d8-8039-b1f575d4347f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.878318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039303f2454047bf836229c058c1bda6', 'request_id': 'req-d9ff751a-a42e-47d8-8039-b1f575d4347f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.892762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] The token cache is being invalidate because project 039303f2454047bf836229c058c1bda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:51.893225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.894461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d9ff751a-a42e-47d8-8039-b1f575d4347f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:51.896231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1087/2175] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:51 2022] DELETE /identity/v3/projects/039303f2454047bf836229c058c1bda6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:51.901057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:51.901563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:51.901693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:51.924910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:51.926093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:51.991649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1089/2176] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:51.999702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:51.999994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.000270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.021141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:52.022432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:52.033407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1088/2177] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:52.037760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.049718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94adc-bd2b-414b-a456-9666eea5bc94 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.054572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.055215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.055497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.056284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.056559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:52.056869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.059594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.072465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1090/2178] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:07:52.076840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.086364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04b01-bc2c-4253-a16b-c4c229df6dc5 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.092038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.092649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.092931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.093204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.094186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.096287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.113367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:52.134697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1089/2179] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:52 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:52.136857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.148651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c589e9a-8f64-482f-ba96-a96d9bd10fea admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.204455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:52.218508 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.219222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.219756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.220252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.221104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.223167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.248946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1091/2180] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:52 2022] POST /identity/v3/users => generated 280 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:52.253452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.266724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310c106-5302-49d6-a39a-c494cf0e5a7c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.272247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.273263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.273471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.273754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.274410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.276140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.291025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1090/2181] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:52.296562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.310410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159f73-5adc-46ad-b883-13083b09123a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.322363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.323206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.323440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.323675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.324435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.326806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e0245-b9d4-4748-8d81-3c5acaae086c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.344060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1092/2182] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:52.344214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.363385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3875539-f4a4-40d5-9a2e-615a0c7cde5d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.369779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.371048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.371559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.372127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] PATH_INFO: `/v3/projects/70bad98d4330447799b7107487effd5e/users/33835d1e46b54ab180a5e1bd4ef41d9e/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.392527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bad98d4330447799b7107487effd5e, user_id=33835d1e46b54ab180a5e1bd4ef41d9e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.395861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.414379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1091/2183] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:52 2022] PUT /identity/v3/projects/70bad98d4330447799b7107487effd5e/users/33835d1e46b54ab180a5e1bd4ef41d9e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:52.425035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.425343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.425614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.460529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] MFA Rules not processed for user `33835d1e46b54ab180a5e1bd4ef41d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:52.462194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:52.542046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1093/2184] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:52.581186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.583550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:52.659491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d47dd3-6ce3-4cf2-9d05-98558a3a7520 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.663954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.664578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.664866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.665145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.674501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.675972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ec95-2086-47c2-be69-1c578ff42c57 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.686158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1092/2185] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:52.705427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.788809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45761d9b-d879-4877-94bd-d5f81dd38377 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:52.793635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:52.794275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.794561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.794874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] PATH_INFO: `/v3/users/33835d1e46b54ab180a5e1bd4ef41d9e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.796043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33835d1e46b54ab180a5e1bd4ef41d9e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:52.798145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:52.847464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33835d1e46b54ab180a5e1bd4ef41d9e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:52.855098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33835d1e46b54ab180a5e1bd4ef41d9e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:52.855737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33835d1e46b54ab180a5e1bd4ef41d9e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:52.856536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33835d1e46b54ab180a5e1bd4ef41d9e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:52.861929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:52.863988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33835d1e46b54ab180a5e1bd4ef41d9e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:52.885416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1094/2186] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:52 2022] DELETE /identity/v3/users/33835d1e46b54ab180a5e1bd4ef41d9e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:52.890757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:52.891218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:52.891309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:52.912172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:52.913492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:52.984175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1093/2187] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:52.993784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:52.995296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:53.064150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617fa90-8946-4a65-85b4-cd6439b0dab8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.067830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.068435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.068714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.068987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.079047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.080517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fe504-1b7c-468a-adf0-c6f334d745c3 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.090159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1095/2188] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:53.361988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.363437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:53.380457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234779a-1d0b-4ccf-82d2-72e0c3e26cbb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.385512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.386163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.386567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.386794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] PATH_INFO: `/v3/projects/70bad98d4330447799b7107487effd5e` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.388091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bad98d4330447799b7107487effd5e)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.390002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.440316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bad98d4330447799b7107487effd5e', 'request_id': 'req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:53.447811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bad98d4330447799b7107487effd5e', 'request_id': 'req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:53.451212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:53.461333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bad98d4330447799b7107487effd5e', 'request_id': 'req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:53.480087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd92f-05f1-43e8-99c7-d6e5de4ac563 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.480976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd92f-05f1-43e8-99c7-d6e5de4ac563 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.481328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd92f-05f1-43e8-99c7-d6e5de4ac563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.489497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] The token cache is being invalidate because project 70bad98d4330447799b7107487effd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:53.489869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:53.490712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d3cbf022-e3c1-40f9-bf3f-32c2a90e2bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:53.492228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1094/2189] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:53 2022] DELETE /identity/v3/projects/70bad98d4330447799b7107487effd5e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:53.497396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.497693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.497972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.503890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ddabd92f-05f1-43e8-99c7-d6e5de4ac563 None None] MFA Rules not processed for user `46a86d784f304dd5ac119bea5daab51e`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:53.505993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ddabd92f-05f1-43e8-99c7-d6e5de4ac563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:53.517893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:53.519384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:53.573696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1096/2190] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:53.588181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1095/2191] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:53.597268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.597561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.597842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.619815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:53.621263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:53.630545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1097/2192] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:53.635373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.647262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe38595-fa2b-44ca-bbec-163c306a59d2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.653203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.653833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.654119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.654396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.655121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:53.655429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.657038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.669323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1096/2193] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:53.673773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.683244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc875924-b4d8-4917-9410-04098f6aaf2f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.688000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.688615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.688897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.689171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.689805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.691751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.724518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1098/2194] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:53 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:53.725668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.736063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19f95-a8d9-49a7-b32a-fda4c9bbe2bc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.807712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.808459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.808742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.809020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.809829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.811826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.846836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1097/2195] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:53 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:07:53.848291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.867707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af329f74-a5dd-48d0-a945-d691330ad1a7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.874109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.875007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.875277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.875839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.876860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.878594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.897938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1099/2196] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:53.899510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.915804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93128fef-2061-43c4-8723-5161d236f6d7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.922197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.923104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.923611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.924072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.925223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.927059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4add8-90a7-497e-8d2c-4c2c404c1027 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:53.940969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1098/2197] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:53.945472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:53.956769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2cd66-1ae3-439e-9dfc-1481c0452493 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:53.962076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:53.962789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:53.963142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:53.963438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] PATH_INFO: `/v3/projects/74ab110c0e9143f586e78f944d3e8aca/users/9caf7d3eca7a4eec94d90f62791adf04/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:53.995189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ab110c0e9143f586e78f944d3e8aca, user_id=9caf7d3eca7a4eec94d90f62791adf04, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:53.997952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.025479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1100/2198] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:53 2022] PUT /identity/v3/projects/74ab110c0e9143f586e78f944d3e8aca/users/9caf7d3eca7a4eec94d90f62791adf04/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:54.037323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.037572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.037945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.069663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] MFA Rules not processed for user `9caf7d3eca7a4eec94d90f62791adf04`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:54.071019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:54.117957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:54.147327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1099/2199] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:54.152565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.180339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:54.221764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6de1-9c23-4e1c-a15a-292d6cfa633f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.226615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.227273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.227558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.227835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.228473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.230960 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.263338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1101/2200] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:54.265099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.278289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe383fa-1d6f-4494-9793-17b7992246d2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.340796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.341416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.341699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.341970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.342806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.345192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.367174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1100/2201] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:54.371972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.382603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc0fa0-c270-4db6-8351-fd89562a5629 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.387807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.388478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.388833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.389185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.389836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.391471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.402938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1102/2202] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:54.407275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.418167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddcd15-c829-4734-bf7b-7e2e88a6bcfb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.423654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.423654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.423934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.424180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] PATH_INFO: `/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2/users/a5baf942f0e5477795f8e3baa4476cdc/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.439781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c0362a7f1a4224a9ec8efd1505e8c2, user_id=a5baf942f0e5477795f8e3baa4476cdc, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.442513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.456917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1101/2203] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:54 2022] PUT /identity/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2/users/a5baf942f0e5477795f8e3baa4476cdc/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:54.460902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.471701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab73f7-84cb-4a9f-bdee-04f4cde2ffc3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.532236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.532769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.533054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.533333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.533981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.535633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0352313-18d2-4a36-ab9a-f126d09facbf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.549143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1103/2204] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:54.552783 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.565624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5623b2-0cdf-4e11-acfc-1af30583db1d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.570575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.571324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.571656 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.571934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] PATH_INFO: `/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2/users/a5baf942f0e5477795f8e3baa4476cdc/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.574620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c0362a7f1a4224a9ec8efd1505e8c2, user_id=a5baf942f0e5477795f8e3baa4476cdc, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.577625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa7b85-e7dc-4d37-8bef-475390e84f31 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.588857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1102/2205] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:54 2022] PUT /identity/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2/users/a5baf942f0e5477795f8e3baa4476cdc/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:54.599681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3586-7e3d-4c67-bfa0-5b6d94e3bf26 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.600009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3586-7e3d-4c67-bfa0-5b6d94e3bf26 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.600286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b3586-7e3d-4c67-bfa0-5b6d94e3bf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.630915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6d2b3586-7e3d-4c67-bfa0-5b6d94e3bf26 None None] MFA Rules not processed for user `a5baf942f0e5477795f8e3baa4476cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:54.632140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6d2b3586-7e3d-4c67-bfa0-5b6d94e3bf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:54.672396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b520-34ea-4c21-956f-f741249c352b None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.672685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b520-34ea-4c21-956f-f741249c352b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.673136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b520-34ea-4c21-956f-f741249c352b None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.674632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1103/2206] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:07:54.706466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1104/2207] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:54.717813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935b520-34ea-4c21-956f-f741249c352b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:54.719538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a935b520-34ea-4c21-956f-f741249c352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:54.724991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a08d-4b00-451a-93eb-0ebcf69693d9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.725762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a08d-4b00-451a-93eb-0ebcf69693d9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.726148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a08d-4b00-451a-93eb-0ebcf69693d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.749375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5f25a08d-4b00-451a-93eb-0ebcf69693d9 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:54.750791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5f25a08d-4b00-451a-93eb-0ebcf69693d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:54.790686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:54.804731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935b520-34ea-4c21-956f-f741249c352b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:54.810182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:54.811015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.811351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.811678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.880669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1105/2208] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:54.884273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:54.915163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:54.918562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc327-9caa-401b-89d1-73df6596cf6b service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:54.931602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1104/2209] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:54.972124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2fb0c-c717-444b-b169-a9b0839d9915 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.972461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2fb0c-c717-444b-b169-a9b0839d9915 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.972695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2fb0c-c717-444b-b169-a9b0839d9915 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:54.974221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1106/2210] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 22 17:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:07:54.983234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:54.983592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:54.983818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:55.009288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] MFA Rules not processed for user `30ceabc5940d40cf8a339f17a375716c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:55.010110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:55.047641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1105/2211] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 22 17:07:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:55.065124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2fb0c-c717-444b-b169-a9b0839d9915 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:55.092235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2fb0c-c717-444b-b169-a9b0839d9915 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:55.099114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:55.100355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:55.100646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:55.100927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:55.115452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:55.117435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:55.147450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1107/2212] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:07:55.608173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:55.609719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:55.679833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b803-1c6e-43a0-8050-eb7ab7cc5893 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:55.686570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:55.687295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:55.687623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:55.688044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] PATH_INFO: `/v3/users/c808b405d5ec4905a65a9706ec8ebeda` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:55.689425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c808b405d5ec4905a65a9706ec8ebeda)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:55.692452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:55.746758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c808b405d5ec4905a65a9706ec8ebeda'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:55.756753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c808b405d5ec4905a65a9706ec8ebeda'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:55.757418 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c808b405d5ec4905a65a9706ec8ebeda'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:55.758043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c808b405d5ec4905a65a9706ec8ebeda'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:55.766129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c808b405d5ec4905a65a9706ec8ebeda'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:55.785090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1106/2213] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:55 2022] DELETE /identity/v3/users/c808b405d5ec4905a65a9706ec8ebeda => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:55.976087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:56.002716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72783527-9520-4b8f-988b-349b32e16a41 service placement] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:56.060071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:56.060794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.061072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.061361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] PATH_INFO: `/v3/projects/5b0ba055bfcb4c118badeac631651109` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.062481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0ba055bfcb4c118badeac631651109)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:56.064443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:56.113131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0ba055bfcb4c118badeac631651109', 'request_id': 'req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.119183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0ba055bfcb4c118badeac631651109', 'request_id': 'req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.127487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0ba055bfcb4c118badeac631651109', 'request_id': 'req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.137941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] The token cache is being invalidate because project 5b0ba055bfcb4c118badeac631651109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:56.138236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.138900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.140380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1108/2214] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:55 2022] DELETE /identity/v3/projects/5b0ba055bfcb4c118badeac631651109 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:56.144608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:56.146604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:56.160066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e222d7-0b88-4010-b6e7-506295d3ff60 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:56.221657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:56.222362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.222559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.222856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] PATH_INFO: `/v3/users/03cdea3fd96546ca8a37caf14c028ffb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.223979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cdea3fd96546ca8a37caf14c028ffb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:56.226197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:56.227822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:56.289764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cdea3fd96546ca8a37caf14c028ffb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.297208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cdea3fd96546ca8a37caf14c028ffb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.297848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cdea3fd96546ca8a37caf14c028ffb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.298493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cdea3fd96546ca8a37caf14c028ffb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.305574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8d00efec-5147-4d47-9fe7-b142f4fba468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cdea3fd96546ca8a37caf14c028ffb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.323314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1107/2215] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:56 2022] DELETE /identity/v3/users/03cdea3fd96546ca8a37caf14c028ffb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:56.581828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:56.581828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:56.608120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9548e-2b3c-4697-b7a3-db3e6a5b9971 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:56.675999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:56.717089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:56.717784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.718109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.718386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] PATH_INFO: `/v3/projects/05a37ffe7ca14a739f40db2dac8862b8` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.720049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a37ffe7ca14a739f40db2dac8862b8)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:56.727268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:56.780430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a37ffe7ca14a739f40db2dac8862b8', 'request_id': 'req-e2dc6d5a-a706-4dd3-a48b-31589a09f666'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.787016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a37ffe7ca14a739f40db2dac8862b8', 'request_id': 'req-e2dc6d5a-a706-4dd3-a48b-31589a09f666'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.796777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a37ffe7ca14a739f40db2dac8862b8', 'request_id': 'req-e2dc6d5a-a706-4dd3-a48b-31589a09f666'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.808834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] The token cache is being invalidate because project 05a37ffe7ca14a739f40db2dac8862b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:56.809140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.809987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e2dc6d5a-a706-4dd3-a48b-31589a09f666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:56.811651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1109/2216] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:56 2022] DELETE /identity/v3/projects/05a37ffe7ca14a739f40db2dac8862b8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:56.816459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.816755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.817036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.837730 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:56.839058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:56.908310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1108/2217] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:56.916356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.916728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.917138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.938924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:56.940137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:56.949051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1110/2218] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:56.954117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:56.965059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aef3fa-0b70-4d17-a459-0639ef4b8d93 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:56.969394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:56.970053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:56.970371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:56.970665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:56.971339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:56.971645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:56.973322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:56.994242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1109/2219] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:56.999482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.008976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a333a-6965-4b2e-a9d0-085d2e708022 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.014612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.015251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.015531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.015803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.016438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.018580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.055149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1111/2220] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:56 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:57.056362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.067137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bbac4-a66c-467c-ac20-c5d1fd8e9dd0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.129939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.130729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.131020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.131303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.131969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.133949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.147355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:57.163300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1110/2221] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:57.164719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.176855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fd3c-7a10-4679-9ea1-3f9eb8e6b50b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.181749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.182437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.182763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.183803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.184459 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.186162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.196631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1112/2222] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:57.201423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.212501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b352a-4611-417f-a253-540773abe58f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.217905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.218518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.218843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.219125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.219770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.221394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992898d-9354-4dcb-b8d2-ae157cf21d4c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.233485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1111/2223] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:57.237296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.249274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95a45-c1ef-45d2-90a3-aa5585f6f3e6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.274294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.275092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.275601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.276064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] PATH_INFO: `/v3/projects/14d4be3aeeec45479b93b6dd5d838a26/users/89596e1b4f39427e9ec3d0821299882e/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.297648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d4be3aeeec45479b93b6dd5d838a26, user_id=89596e1b4f39427e9ec3d0821299882e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.300612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.314849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1113/2224] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:57 2022] PUT /identity/v3/projects/14d4be3aeeec45479b93b6dd5d838a26/users/89596e1b4f39427e9ec3d0821299882e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:57.325505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.325794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.326067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.357782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] MFA Rules not processed for user `89596e1b4f39427e9ec3d0821299882e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:57.359256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:57.430726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1112/2225] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:57.435362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.498976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:57.501953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6109c0c-73e7-47bb-8c25-dbf8e8089dea admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.508047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.508800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.509131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.509658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.510542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.513345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.542988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1114/2226] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:57.547385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.558576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df8db9-f0d2-4888-878c-34101a1ac12d None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.617992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.618610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.618928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.619200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.619833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.621785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.647160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1113/2227] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:57.651591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.662689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976888cb-d8bd-4878-a262-5dfe3c86bc1a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.668088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.668825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.669211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.669600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.670320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.672073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.683470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1115/2228] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:57.687577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.697577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15867b-fec6-4272-9607-94d766211664 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.703007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.703609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.703894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.704170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.704843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.706451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.716799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1114/2229] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:57.721058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.731576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373e0a7-f2e5-4b03-a535-9131e929dd26 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.736174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.736828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.737112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.737390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] PATH_INFO: `/v3/projects/70cc4e780f7e4f61872e8ed83ae716dc/users/e3418e2d40df4e389ca6a03fe6ec4c10/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.755680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc4e780f7e4f61872e8ed83ae716dc, user_id=e3418e2d40df4e389ca6a03fe6ec4c10, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.759405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063769c-a40f-4559-97f9-ac6eb78d7e3b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.780586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.784294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:57.784726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1116/2230] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:57 2022] PUT /identity/v3/projects/70cc4e780f7e4f61872e8ed83ae716dc/users/e3418e2d40df4e389ca6a03fe6ec4c10/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:57.796381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.796770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.797013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.799150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491121e-2734-4443-8862-a5715d3e2ac6 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.830683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] MFA Rules not processed for user `e3418e2d40df4e389ca6a03fe6ec4c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:57.832186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:57.855566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:57.871032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.871693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.871974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.872250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] PATH_INFO: `/v3/users/9caf7d3eca7a4eec94d90f62791adf04` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.873482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9caf7d3eca7a4eec94d90f62791adf04)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.875491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.920795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1117/2231] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:07:57.925098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.936659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35de895-b6f1-4d72-bd92-9c82df2737b9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:57.938832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9caf7d3eca7a4eec94d90f62791adf04'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:57.941561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:57.942176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.942491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.942944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:57.943441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:57.945719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:57.949311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9caf7d3eca7a4eec94d90f62791adf04'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:57.950061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9caf7d3eca7a4eec94d90f62791adf04'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:57.950788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9caf7d3eca7a4eec94d90f62791adf04'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:57.959311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-081debc2-8977-45d3-bcd5-609d87915637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9caf7d3eca7a4eec94d90f62791adf04'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:57.977131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1118/2232] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:57.981954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:57.987605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:57.987960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1115/2233] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:57 2022] DELETE /identity/v3/users/9caf7d3eca7a4eec94d90f62791adf04 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:57.992697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:57.993787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:57.994318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.019642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:58.020877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.062267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39702da4-f2fa-4ee3-9390-923cf855ae96 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.085101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:58.096236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1116/2234] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:58.103813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.106088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.138478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.139206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.139570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.139938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.140582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.144111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.173550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1119/2235] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:57 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:58.177224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.189984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b262-0c62-4d54-8048-814d60f9af06 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.196271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.196893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.197174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.197452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.198093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.200320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.208830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889471a-ca98-41ad-a75c-1f9468089085 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.211079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1120/2236] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:07:58.212727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.213367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.213651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.213947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.215445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.223867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.225334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.225806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104953a-bb80-4ad9-9fb0-e0910653c384 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.231202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.231864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.232147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.232425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] PATH_INFO: `/v3/projects/6db92356064a4b74bbcd5bc50f956bc8/users/7127f5cda57a412fb4145300833784f8/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.236113 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1117/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:58.248437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db92356064a4b74bbcd5bc50f956bc8, user_id=7127f5cda57a412fb4145300833784f8, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.251135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.279404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1121/2238] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:58 2022] PUT /identity/v3/projects/6db92356064a4b74bbcd5bc50f956bc8/users/7127f5cda57a412fb4145300833784f8/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:58.283123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.294924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860722-1bb1-4454-b36d-f308d974138e service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.313162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:58.376138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.376877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.377184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.377878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.378548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.381279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3915-c351-4305-8101-e970f067ea71 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.395728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1118/2239] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:58.400014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.416060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097b1bf-5fb1-4bdc-bf51-526df8380f65 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.421448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.422835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.422835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.422835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] PATH_INFO: `/v3/projects/6db92356064a4b74bbcd5bc50f956bc8/users/7127f5cda57a412fb4145300833784f8/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.424778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db92356064a4b74bbcd5bc50f956bc8, user_id=7127f5cda57a412fb4145300833784f8, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.427465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.441465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1122/2240] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:07:58 2022] PUT /identity/v3/projects/6db92356064a4b74bbcd5bc50f956bc8/users/7127f5cda57a412fb4145300833784f8/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:58.453387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.453686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.453962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.497664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] MFA Rules not processed for user `7127f5cda57a412fb4145300833784f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:58.498935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.568159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.571158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.661679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1119/2241] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:58.673849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.676713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.710789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0771b-7c51-4efe-b84e-fa11f943893f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.718300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.719867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.720309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.720735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] PATH_INFO: `/v3/projects/74ab110c0e9143f586e78f944d3e8aca` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.722759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ab110c0e9143f586e78f944d3e8aca)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.725117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.766481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0072ffb-c0d7-4680-b8d2-995cf334e830 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.772458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.773643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.773954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.774479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.778082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.805631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ab110c0e9143f586e78f944d3e8aca', 'request_id': 'req-25020698-ec82-491a-a3db-a18b9c3f062d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:58.815972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ab110c0e9143f586e78f944d3e8aca', 'request_id': 'req-25020698-ec82-491a-a3db-a18b9c3f062d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:58.840107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ab110c0e9143f586e78f944d3e8aca', 'request_id': 'req-25020698-ec82-491a-a3db-a18b9c3f062d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:58.851093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:58.862511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] The token cache is being invalidate because project 74ab110c0e9143f586e78f944d3e8aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:58.863145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:58.864011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:58.864972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:58.871299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1123/2242] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:58 2022] DELETE /identity/v3/projects/74ab110c0e9143f586e78f944d3e8aca => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:07:58.872464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:58.873782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:58.900932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.903324 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:58.929139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1120/2243] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:07:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:07:58.960040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25020698-ec82-491a-a3db-a18b9c3f062d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:58.971037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:58.971697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:58.971985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:58.972270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] PATH_INFO: `/v3/users/a5baf942f0e5477795f8e3baa4476cdc` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:58.975601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5baf942f0e5477795f8e3baa4476cdc)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:58.977627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.035882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5baf942f0e5477795f8e3baa4476cdc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.044338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5baf942f0e5477795f8e3baa4476cdc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.045333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5baf942f0e5477795f8e3baa4476cdc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.047689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5baf942f0e5477795f8e3baa4476cdc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.058798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-f2af3d4d-8166-4c69-8a1b-f96911cbd824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5baf942f0e5477795f8e3baa4476cdc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.080736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1124/2244] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:07:58 2022] DELETE /identity/v3/users/a5baf942f0e5477795f8e3baa4476cdc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:59.420732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.443747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474432c2-cca6-462c-9cb1-5966cbef1474 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:59.516984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:59.517604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.517893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.518432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] PATH_INFO: `/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.519591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c0362a7f1a4224a9ec8efd1505e8c2)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:59.521544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.568143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c0362a7f1a4224a9ec8efd1505e8c2', 'request_id': 'req-d94e5b0d-1392-4114-b407-42f228cffbf0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.575111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c0362a7f1a4224a9ec8efd1505e8c2', 'request_id': 'req-d94e5b0d-1392-4114-b407-42f228cffbf0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.582333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c0362a7f1a4224a9ec8efd1505e8c2', 'request_id': 'req-d94e5b0d-1392-4114-b407-42f228cffbf0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.593011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] The token cache is being invalidate because project 70c0362a7f1a4224a9ec8efd1505e8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:07:59.593302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.593976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-d94e5b0d-1392-4114-b407-42f228cffbf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:07:59.595483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1121/2245] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:07:59 2022] DELETE /identity/v3/projects/70c0362a7f1a4224a9ec8efd1505e8c2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:07:59.600454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.600918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.601045 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.621105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:59.622291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:59.684337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1125/2246] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:59.693700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.694069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.694521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.715595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:07:59.717033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:07:59.724844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1122/2247] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:07:59.729104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.740127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba5157-1f4e-4768-b737-ed25871c5e7e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:59.745878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:59.746530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.747506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.747952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.749031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:07:59.750090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:59.752407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.763986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:59.772607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1126/2248] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:07:59.774765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.785951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030605ad-052f-496d-8ec9-e225bef4d1a6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:59.790519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:59.791137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.791417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.791685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.792984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:59.796088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.827124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1123/2249] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:07:59 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:59.831340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.842559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ce4d9-3514-41da-879f-bc490b74e8e0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:59.906901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:59.907518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.907805 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.908083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.908743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:59.910692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.933808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1127/2250] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:07:59 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:07:59.938018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.949913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5231c-3572-4655-92b2-76351282dbe5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:07:59.956991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:07:59.957683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:07:59.958125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:07:59.958549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:07:59.959291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:07:59.961150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:07:59.975774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1124/2251] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:07:59.977288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:07:59.998489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4461-8a51-46c8-976d-52a36ed05e8d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:00.003187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:00.003890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:00.004175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:00.004450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:00.005118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:00.006789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaa8ad-84c2-4713-85c2-54bc84fb14a9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:00.024071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1128/2252] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:08:00.025816 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:00.038231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bd45-fadb-44f5-a128-255c41dfbdb8 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:00.044985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:00.046703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:00.047408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:00.047545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] PATH_INFO: `/v3/projects/22535b2f30aa4e16abc31e98431b553d/users/521db94671b14543a97fb5a4ef34281a/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:00.069905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22535b2f30aa4e16abc31e98431b553d, user_id=521db94671b14543a97fb5a4ef34281a, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:00.072814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:00.088462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1125/2253] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:08:00 2022] PUT /identity/v3/projects/22535b2f30aa4e16abc31e98431b553d/users/521db94671b14543a97fb5a4ef34281a/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:00.094699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:00.095160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:00.095499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:00.118766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:00.120290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:00.191790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1129/2254] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:08:00.201954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:00.205737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:00.232996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:00.277507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f4537-55f5-430a-8883-62ab7d9cad62 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:00.281977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:00.282695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:00.283054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:00.285106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:00.295357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:00.296813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0871e9-67df-4a39-a4f3-3b19857c1b9b service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:00.306516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1126/2255] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:00.721031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:00.722613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:00.796682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e44fa-a7c1-4d4d-9dbb-44338b22823e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:00.800889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:00.801592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:00.801949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:00.802503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:00.804479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:00.848929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:00.883546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:00.885182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:00.896808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1130/2256] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:01.264118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:01.264598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:01.264739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:01.313270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] MFA Rules not processed for user `521db94671b14543a97fb5a4ef34281a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:01.315539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:01.502782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1127/2257] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:01.516812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:01.518531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:01.536081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c80a3-cb9e-41fb-b39f-0f25249f02f1 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:01.543235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:01.548717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:01.549286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:01.549594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:01.570703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:01.575407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d6ff9-c305-405b-a9f4-ddb9cd9be8af service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:01.599062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1131/2258] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:01.996268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:02.008667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5907e-0475-4fae-9be7-593ddbe5e42e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:02.013493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:02.014090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:02.014339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:02.014642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:02.016448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:02.094692 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:02.096107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022359c-d743-4fbb-aa8a-b1aecd2b4baa service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:02.106439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1128/2259] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:03.068520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:03.069030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:03.069184 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:03.091482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] MFA Rules not processed for user `521db94671b14543a97fb5a4ef34281a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:03.092716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:03.101108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1132/2260] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:04.597464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170599a-e14a-43c4-a64b-834c2e4ad515 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:04.597969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170599a-e14a-43c4-a64b-834c2e4ad515 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:04.598062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170599a-e14a-43c4-a64b-834c2e4ad515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:04.618070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d170599a-e14a-43c4-a64b-834c2e4ad515 None None] MFA Rules not processed for user `0f915e1541084ef88223a405a0536ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:04.619517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d170599a-e14a-43c4-a64b-834c2e4ad515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:04.672996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:04.690631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1129/2261] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:06.115795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:06.117352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:06.131542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad90caf-0b1f-4ba1-a212-d8b9a883140e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:06.137094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:06.137739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:06.138023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:06.138301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] PATH_INFO: `/v3/users/89596e1b4f39427e9ec3d0821299882e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:06.139468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89596e1b4f39427e9ec3d0821299882e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:06.141383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:06.192715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89596e1b4f39427e9ec3d0821299882e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:06.202571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89596e1b4f39427e9ec3d0821299882e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:06.203331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89596e1b4f39427e9ec3d0821299882e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:06.204034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89596e1b4f39427e9ec3d0821299882e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:06.211777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89596e1b4f39427e9ec3d0821299882e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:06.231906 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1133/2262] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:08:06 2022] DELETE /identity/v3/users/89596e1b4f39427e9ec3d0821299882e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:08:06.236290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:06.236768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:06.236886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:06.256835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:06.258039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:06.344744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1130/2263] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:06.354581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:06.356054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:06.418323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660112-670a-4c2e-b80e-5584472408f5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:06.422213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:06.422878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:06.423146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:06.423417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:06.432297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:06.434078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:06.443961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1134/2264] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:06.918594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:06.920575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:06.940575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad344c-5311-4b66-bf9e-21c71d112efe None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:06.954923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:06.955691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:06.956044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:06.956390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] PATH_INFO: `/v3/projects/14d4be3aeeec45479b93b6dd5d838a26` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:06.957826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d4be3aeeec45479b93b6dd5d838a26)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:06.960002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:07.045364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d4be3aeeec45479b93b6dd5d838a26', 'request_id': 'req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.052385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d4be3aeeec45479b93b6dd5d838a26', 'request_id': 'req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.060820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d4be3aeeec45479b93b6dd5d838a26', 'request_id': 'req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.075459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] The token cache is being invalidate because project 14d4be3aeeec45479b93b6dd5d838a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:08:07.075459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.076601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.089044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1131/2265] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:08:06 2022] DELETE /identity/v3/projects/14d4be3aeeec45479b93b6dd5d838a26 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:08:07.091095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:07.105348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24329c5-9587-4472-9db4-8a55aea45fe2 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:07.147035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:07.194927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:07.195949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:07.196401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:07.196844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] PATH_INFO: `/v3/users/e3418e2d40df4e389ca6a03fe6ec4c10` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:07.198864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3418e2d40df4e389ca6a03fe6ec4c10)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:07.201607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:07.263106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3418e2d40df4e389ca6a03fe6ec4c10'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.272872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3418e2d40df4e389ca6a03fe6ec4c10'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.273513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3418e2d40df4e389ca6a03fe6ec4c10'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.274329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3418e2d40df4e389ca6a03fe6ec4c10'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.282571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3418e2d40df4e389ca6a03fe6ec4c10'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.307185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1135/2266] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:08:07 2022] DELETE /identity/v3/users/e3418e2d40df4e389ca6a03fe6ec4c10 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:07.665221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:07.666406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:07.699614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d72b-ad54-4b6c-a71a-1b47d4cad63a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:07.791045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:07.791045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:07.791045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:07.791045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] PATH_INFO: `/v3/projects/70cc4e780f7e4f61872e8ed83ae716dc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:07.791846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cc4e780f7e4f61872e8ed83ae716dc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:07.793970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:07.823052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:07.870899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cc4e780f7e4f61872e8ed83ae716dc', 'request_id': 'req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.878055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cc4e780f7e4f61872e8ed83ae716dc', 'request_id': 'req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.886815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cc4e780f7e4f61872e8ed83ae716dc', 'request_id': 'req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.906951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] The token cache is being invalidate because project 70cc4e780f7e4f61872e8ed83ae716dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:08:07.907254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.907917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:07.909609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1132/2267] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:08:07 2022] DELETE /identity/v3/projects/70cc4e780f7e4f61872e8ed83ae716dc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:07.913476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:07.915042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:07.929551 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274893d6-a2e1-4303-a431-f0fa5896a730 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:07.998941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:07.999577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:07.999854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.000124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] PATH_INFO: `/v3/users/7127f5cda57a412fb4145300833784f8` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.001258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7127f5cda57a412fb4145300833784f8)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.003214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.048734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7127f5cda57a412fb4145300833784f8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.051200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:08.057693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7127f5cda57a412fb4145300833784f8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.058600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7127f5cda57a412fb4145300833784f8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.059449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7127f5cda57a412fb4145300833784f8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.067259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-053d7d12-cde9-48f6-8b18-ca84abd78b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7127f5cda57a412fb4145300833784f8'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.084714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1136/2268] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:08:07 2022] DELETE /identity/v3/users/7127f5cda57a412fb4145300833784f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:08.403301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.404729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:08.417658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf6c1-2d97-4f66-8dd4-b3bb4c6f24f3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.475661 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.476295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.476578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.476857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] PATH_INFO: `/v3/projects/6db92356064a4b74bbcd5bc50f956bc8` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.477988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db92356064a4b74bbcd5bc50f956bc8)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.480667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.529880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db92356064a4b74bbcd5bc50f956bc8', 'request_id': 'req-5f9d4406-c120-4653-9e81-24358a2e385c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.536034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db92356064a4b74bbcd5bc50f956bc8', 'request_id': 'req-5f9d4406-c120-4653-9e81-24358a2e385c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.543958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db92356064a4b74bbcd5bc50f956bc8', 'request_id': 'req-5f9d4406-c120-4653-9e81-24358a2e385c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.554016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] The token cache is being invalidate because project 6db92356064a4b74bbcd5bc50f956bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:08:08.554301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.554941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5f9d4406-c120-4653-9e81-24358a2e385c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:08.556416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1133/2269] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:08:08 2022] DELETE /identity/v3/projects/6db92356064a4b74bbcd5bc50f956bc8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:08.562384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.562882 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.562992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.583606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:08.584808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:08.646857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1137/2270] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:08.656043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.656600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.656908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.676943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:08.678154 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:08.687163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1134/2271] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:08:08.691393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.701909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2ded-edaf-4c0a-8052-8906d19fa1b2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.706704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.707404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.707759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.708097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.708815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:08:08.709186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.710824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.723283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1138/2272] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:08:08.727863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.738092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d71d7f-2813-4d63-97b9-868d1703a2b3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.742872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.743516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.743802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.744108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.745380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.747936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.778749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1135/2273] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:08:08 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:08:08.783005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.794355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6cb1d-a6f3-4b3d-9ce4-49513960c00f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.866619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.867626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.867898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.868163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.868818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.872076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.902557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1139/2274] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:08:08 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:08:08.904194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.912192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:08.918625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce3b0e-5e62-4dc8-9295-e73bf8bddf74 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.925772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.926362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.927189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.927394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.928172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.930131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.941407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1136/2275] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:08:08.945800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.956705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a48b4-a3cc-4090-82f7-9a66fbd5ac7b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.961846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:08.962466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:08.962774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:08.963051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:08.964853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:08.966584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e0be3-8303-459e-97d9-121e3b208d9c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:08.978076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1140/2276] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:08:08.984049 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:08.994556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a6815-9889-4fc3-b992-a3b943259fc1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:08.999970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:09.001146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:09.001925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:09.010702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] PATH_INFO: `/v3/projects/71f16ae3bdea43ae9b1d68fbe1def618/users/d0c045b364644a688108a6b3b88b6bed/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:09.051515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f16ae3bdea43ae9b1d68fbe1def618, user_id=d0c045b364644a688108a6b3b88b6bed, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:09.054249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:09.076173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1137/2277] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:08:08 2022] PUT /identity/v3/projects/71f16ae3bdea43ae9b1d68fbe1def618/users/d0c045b364644a688108a6b3b88b6bed/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:09.087946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f601fb-4b7d-4fcc-b027-084b59caa65d None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:09.089015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f601fb-4b7d-4fcc-b027-084b59caa65d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:09.089690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f601fb-4b7d-4fcc-b027-084b59caa65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:09.126010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-19f601fb-4b7d-4fcc-b027-084b59caa65d None None] MFA Rules not processed for user `d0c045b364644a688108a6b3b88b6bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:09.127258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-19f601fb-4b7d-4fcc-b027-084b59caa65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:09.149537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:09.219093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1141/2278] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:09.232712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:09.234612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:09.327853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583db27-217a-47d2-8c88-48cc61ca6bde admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:09.331693 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:09.333474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:09.333474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:09.333474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:09.342988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:09.344538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:09.354722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1138/2279] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:13.862627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf3b3-1174-4a1f-8d28-b0e56a2e5df7 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:13.863169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf3b3-1174-4a1f-8d28-b0e56a2e5df7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:13.863310 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bf3b3-1174-4a1f-8d28-b0e56a2e5df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:13.883059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-288bf3b3-1174-4a1f-8d28-b0e56a2e5df7 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:13.884302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-288bf3b3-1174-4a1f-8d28-b0e56a2e5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:13.949742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1142/2280] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:08:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:14.000191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:14.001697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:14.084719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbd99-a545-4b3a-9f97-ea259682ef0b service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:14.090079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:14.091241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:14.091241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:14.091586 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:14.101634 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:14.104149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c6727-c005-48e8-bd46-dccab31c1827 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:14.117952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1139/2281] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:08:23.951185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=42 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:24.115394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:31.771977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:31.772614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:31.772614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:31.796172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] MFA Rules not processed for user `071a117b156f46b0b3afb5c47b3baef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:31.797921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:31.864443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1143/2282] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:38.321367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54ed3-f5c9-4078-8cb1-1894856b5f16 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:38.321905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54ed3-f5c9-4078-8cb1-1894856b5f16 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:38.322034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae54ed3-f5c9-4078-8cb1-1894856b5f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:38.342856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8ae54ed3-f5c9-4078-8cb1-1894856b5f16 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:38.344099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8ae54ed3-f5c9-4078-8cb1-1894856b5f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:38.351380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1140/2283] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:08:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:38.365645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:38.378239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f2e27-51d2-4d6f-acc8-2c35b13bd420 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:38.383769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:38.384496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:38.384847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:38.385317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:38.394494 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:38.396140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:38.407204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1144/2284] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:08:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:08:39.048736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:39.049327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:39.049609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:39.101379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:39.105011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:39.142863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1141/2285] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:08:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:39.160210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:39.173837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94696d-630c-4c4c-9507-69684aa1d585 service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:39.183962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:39.185666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:39.187067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:39.187589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:39.236833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:39.239321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:39.259289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1145/2286] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:08:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 17:08:42.098006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:42.099528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:42.262772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec4be1-723d-439b-9fd8-0f036e5641f0 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:42.268795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:42.269800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:42.270275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:42.271072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] PATH_INFO: `/v3/users/46a86d784f304dd5ac119bea5daab51e` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:42.273836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a86d784f304dd5ac119bea5daab51e)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:42.277610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:42.359639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a86d784f304dd5ac119bea5daab51e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.370962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a86d784f304dd5ac119bea5daab51e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.371725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a86d784f304dd5ac119bea5daab51e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.372424 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a86d784f304dd5ac119bea5daab51e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.381754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5d80812c-a2fe-4988-a50d-8972bff0e3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a86d784f304dd5ac119bea5daab51e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.427267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1142/2287] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:08:42 2022] DELETE /identity/v3/users/46a86d784f304dd5ac119bea5daab51e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:42.674831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:42.689432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0032d8-dd65-46fa-8122-02c0bb8fd931 service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:42.789624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:42.790751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:42.792677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:42.793724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] PATH_INFO: `/v3/projects/3cb76f2db31e442095072e52c0b5dc2d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:42.796704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb76f2db31e442095072e52c0b5dc2d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:42.833097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:42.966901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb76f2db31e442095072e52c0b5dc2d', 'request_id': 'req-412736a9-9ccc-4764-82af-9e5bee0e942d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:42.994754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb76f2db31e442095072e52c0b5dc2d', 'request_id': 'req-412736a9-9ccc-4764-82af-9e5bee0e942d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:43.007595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb76f2db31e442095072e52c0b5dc2d', 'request_id': 'req-412736a9-9ccc-4764-82af-9e5bee0e942d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:43.027243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] The token cache is being invalidate because project 3cb76f2db31e442095072e52c0b5dc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:08:43.027633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:43.028379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-412736a9-9ccc-4764-82af-9e5bee0e942d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:43.030200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1146/2288] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:08:42 2022] DELETE /identity/v3/projects/3cb76f2db31e442095072e52c0b5dc2d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:43.034843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.035204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.035540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.056867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:43.058186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:43.145593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1143/2289] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:43.153970 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.154246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.154523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.182607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:43.184007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:43.206510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1147/2290] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:43.211107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.223603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c54f4-a772-4ea1-b47b-42c6d486aa2e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.229571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.230484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.230985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.231433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.232315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:08:43.232821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.234551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.237923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:43.256702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1144/2291] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:08:43.261460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.267682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:43.275192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef3fc0-cff3-4c9c-9e38-ea9ebc4b5580 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.283927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.285317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.285908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.287406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.290097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.295007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.353892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1148/2292] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:08:43 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:08:43.358413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.375269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41168c-f1b3-457e-a933-fa465d5be835 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.518196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.518854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.519146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.519425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.520248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.522348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.582683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1145/2293] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:08:43 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:08:43.583056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.603328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef709-cdd3-4359-ba50-f8c0c87ee39c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.609277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.610123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.610585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.611161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.614776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.616761 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.642120 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1149/2294] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:08:43.643130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.654066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d87617-3cf2-41b7-ad68-058b435807a7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.658886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.659493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.659780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.660067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.660807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.662430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c969ac4-c489-48dc-a944-5ba0c3152519 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.685869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:43.687216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1146/2295] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:08:43.704406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3e6e-7eca-4964-bec2-0c547d0d9798 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:43.715237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:43.716071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.716456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.719115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] PATH_INFO: `/v3/projects/8850d5a453714f7497e86e8a720efb7a/users/498bff34634148649e267a2fe60cff0b/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.743747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8850d5a453714f7497e86e8a720efb7a, user_id=498bff34634148649e267a2fe60cff0b, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:43.747450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:43.771803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1150/2296] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:08:43 2022] PUT /identity/v3/projects/8850d5a453714f7497e86e8a720efb7a/users/498bff34634148649e267a2fe60cff0b/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:08:43.846923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:43.847543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:43.848061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:43.879316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] MFA Rules not processed for user `498bff34634148649e267a2fe60cff0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:43.880755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:44.019472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1147/2297] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:44.031061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:44.033164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:44.164074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6bd6-8932-4af1-9ffe-7386cbfab3a5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:44.171580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:44.172261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:44.172520 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:44.172839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:44.184305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:44.186088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2849-7636-454d-a413-71b38c447069 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:44.197954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1151/2298] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:44.233442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:44.328711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bfcc0-1f30-4a39-a697-79c73b89dde2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:44.333961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:44.334624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:44.334947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:44.335225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] PATH_INFO: `/v3/users/498bff34634148649e267a2fe60cff0b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:44.336614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=498bff34634148649e267a2fe60cff0b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:44.341387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:44.344355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:44.404610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498bff34634148649e267a2fe60cff0b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:44.412843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498bff34634148649e267a2fe60cff0b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:44.413484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498bff34634148649e267a2fe60cff0b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:44.414288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498bff34634148649e267a2fe60cff0b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:44.422794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498bff34634148649e267a2fe60cff0b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:44.449126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1148/2299] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:08:44 2022] DELETE /identity/v3/users/498bff34634148649e267a2fe60cff0b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:44.453814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:44.454102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:44.454386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:44.475655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:44.477478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:44.576846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1152/2300] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:44.577962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:44.579648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:44.648619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fbdee-649d-4717-8b6c-e786240b7eff admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:44.671235 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:44.671989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:44.672370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:44.672869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:44.692726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:44.695497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd847e-db75-4ea3-88c2-c572d30c8bc5 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:44.707913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1149/2301] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:45.078698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:45.081031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:45.101252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf92e0-fed2-4fae-a79e-9358e7606a82 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:45.109081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:45.112350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:45.112646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:45.112917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] PATH_INFO: `/v3/projects/8850d5a453714f7497e86e8a720efb7a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:45.115804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8850d5a453714f7497e86e8a720efb7a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:45.122047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:45.177727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:45.183870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8850d5a453714f7497e86e8a720efb7a', 'request_id': 'req-cb0d26f7-a331-4bf7-a7bb-d054903083cb'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:45.203519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8850d5a453714f7497e86e8a720efb7a', 'request_id': 'req-cb0d26f7-a331-4bf7-a7bb-d054903083cb'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:45.213958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8850d5a453714f7497e86e8a720efb7a', 'request_id': 'req-cb0d26f7-a331-4bf7-a7bb-d054903083cb'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:45.228361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] The token cache is being invalidate because project 8850d5a453714f7497e86e8a720efb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:08:45.228657 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:45.229413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cb0d26f7-a331-4bf7-a7bb-d054903083cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:08:45.231161 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1153/2302] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:08:45 2022] DELETE /identity/v3/projects/8850d5a453714f7497e86e8a720efb7a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:08:54.705799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:54.869628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:54.870340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:54.871064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:54.873234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1150/2303] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:08:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:08:54.879335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f511e-f6ee-4a7a-af3a-4d077f6c7934 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:54.883546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f511e-f6ee-4a7a-af3a-4d077f6c7934 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:54.883828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f511e-f6ee-4a7a-af3a-4d077f6c7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:54.908425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-991f511e-f6ee-4a7a-af3a-4d077f6c7934 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:54.909642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-991f511e-f6ee-4a7a-af3a-4d077f6c7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:54.991788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1154/2304] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:08:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:55.006792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:55.008556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:55.067486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32256d09-dd6a-4847-bfc2-0fe83a8ea5c2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:55.071171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:55.071776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.072061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.072336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.082161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:55.083609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684abaf1-37e1-4f51-9ce2-1081f158692c service glance] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:55.094932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1151/2305] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:55.165638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.165923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.166199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.167590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1155/2306] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:08:55.172304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec608-3549-4d9f-9772-92759020c242 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.172598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec608-3549-4d9f-9772-92759020c242 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.172879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eec608-3549-4d9f-9772-92759020c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.193677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-63eec608-3549-4d9f-9772-92759020c242 None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:55.195420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-63eec608-3549-4d9f-9772-92759020c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:55.248500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1152/2307] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:08:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:55.261145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:55.262983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:55.276948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06089667-ef5e-4d1a-aa84-ce6f691ee36d None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:55.280528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:55.281128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.281410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.281686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.288695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:55.290108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de2246-019e-4ae4-9b6b-8a0b62ed5468 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:55.297687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1156/2308] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:08:55.378839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8028-b539-42de-9a90-93771922cc45 None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.379198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8028-b539-42de-9a90-93771922cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.379465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8028-b539-42de-9a90-93771922cc45 None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.380855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1153/2309] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:08:55.386394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2875b-9ae9-4782-801e-96618d6251e1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.386720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2875b-9ae9-4782-801e-96618d6251e1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.387007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2875b-9ae9-4782-801e-96618d6251e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.407299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-a6d2875b-9ae9-4782-801e-96618d6251e1 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:55.408496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a6d2875b-9ae9-4782-801e-96618d6251e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:55.417750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1157/2310] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:08:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:08:55.428280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d8028-b539-42de-9a90-93771922cc45 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:55.439616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d8028-b539-42de-9a90-93771922cc45 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:55.443496 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:55.444638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:55.444921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:55.445192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:55.455438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:55.456862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:55.468171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1154/2311] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:08:57.626984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ed0-b67d-4d0d-9218-35c2aef8686f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:57.628351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ed0-b67d-4d0d-9218-35c2aef8686f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:57.629226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1ed0-b67d-4d0d-9218-35c2aef8686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:57.659789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-643d1ed0-b67d-4d0d-9218-35c2aef8686f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:08:57.662066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-643d1ed0-b67d-4d0d-9218-35c2aef8686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:57.774888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1158/2312] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:08:57.798219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:08:57.800553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:08:57.828668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6b508-5f84-45c1-a14f-22379b080108 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:08:57.838252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:08:57.839718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:08:57.839718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:08:57.839718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:08:57.848410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:08:57.850269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:08:57.864708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1155/2313] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:00.730521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:00.731076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:00.731076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:00.757482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:00.759085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:00.767606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1159/2314] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:00.785276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:00.786993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:00.804366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a48685-a6db-4c95-a1f5-d6df258d4da9 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:00.809986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:00.810729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:00.811012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:00.811283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:00.820514 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:00.822098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48faec5-6df6-440b-8498-b2862b8e2501 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:00.832277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1156/2315] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:02.753811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:02.755594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:02.775198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03acb9-ce70-4700-9c0d-4c46639f1811 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:02.780826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:02.781444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:02.781728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:02.782001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] PATH_INFO: `/v3/users/d0c045b364644a688108a6b3b88b6bed` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:02.783180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c045b364644a688108a6b3b88b6bed)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:02.785125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:02.821223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:02.821724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:02.821834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:02.838367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:02.844123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:02.845524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:02.861541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c045b364644a688108a6b3b88b6bed'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:02.872131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c045b364644a688108a6b3b88b6bed'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:02.872972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c045b364644a688108a6b3b88b6bed'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:02.873566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c045b364644a688108a6b3b88b6bed'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:02.882754 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-55d80c52-55be-4cb2-b560-b3916f6e9f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c045b364644a688108a6b3b88b6bed'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:02.906259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1160/2316] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:09:02 2022] DELETE /identity/v3/users/d0c045b364644a688108a6b3b88b6bed => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:09:02.907758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939a81-055f-4302-a184-20799d31dde4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:02.908111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939a81-055f-4302-a184-20799d31dde4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:02.908453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13939a81-055f-4302-a184-20799d31dde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:02.914991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1157/2317] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:09:02.930548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-13939a81-055f-4302-a184-20799d31dde4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:02.931299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:02.931984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-13939a81-055f-4302-a184-20799d31dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:02.933155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:02.954844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:03.004810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1161/2318] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:03.012881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7d18a-ca0f-41c0-822b-fe28305d7da0 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:03.015481 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13939a81-055f-4302-a184-20799d31dde4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:03.017418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-13939a81-055f-4302-a184-20799d31dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:03.077856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13939a81-055f-4302-a184-20799d31dde4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:03.079788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:03.080433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.080672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.080950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.082126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:03.082767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.083054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.083331 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.093358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:03.095449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:03.105998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1162/2319] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:09:03.140265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:03.142123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845efc1-d924-450a-b80a-18215b5951f9 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:03.150463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1158/2320] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:09:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:09:03.452875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:03.455645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:03.479230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafd554-29ec-459d-8c11-5e2e2f716070 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:03.484573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:03.485357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.485967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.486349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] PATH_INFO: `/v3/projects/71f16ae3bdea43ae9b1d68fbe1def618` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.487719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f16ae3bdea43ae9b1d68fbe1def618)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:03.489807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:03.561891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:03.563341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f16ae3bdea43ae9b1d68fbe1def618', 'request_id': 'req-7d26aef8-cc73-4c8b-95b3-10250cc302d3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:03.571894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f16ae3bdea43ae9b1d68fbe1def618', 'request_id': 'req-7d26aef8-cc73-4c8b-95b3-10250cc302d3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:03.581893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f16ae3bdea43ae9b1d68fbe1def618', 'request_id': 'req-7d26aef8-cc73-4c8b-95b3-10250cc302d3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:03.596653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] The token cache is being invalidate because project 71f16ae3bdea43ae9b1d68fbe1def618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:09:03.597095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:03.597793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d26aef8-cc73-4c8b-95b3-10250cc302d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:03.599720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1163/2321] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:09:03 2022] DELETE /identity/v3/projects/71f16ae3bdea43ae9b1d68fbe1def618 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:09:03.605552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.605865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.606163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.627828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:03.629168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:03.731266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1159/2322] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:03.740201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.741648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.741935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.768827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:03.770042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:03.779330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1164/2323] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:09:03.783691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:03.789116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:03.795921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210000-8d1d-48cf-95f1-c04b2e77f115 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:03.805479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:03.806102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.806387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.806712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.807361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:09:03.807748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:03.809958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:03.824253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1160/2324] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:09:03.829255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:03.839934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75816fb-2922-418f-9ade-d73b1a4f724b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:03.845555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:03.846228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:03.846518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:03.846856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:03.847473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:03.849374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:03.885907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1165/2325] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:09:03 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:09:03.890973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:03.902568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9eac48-372d-4931-a0e1-d9bc7ced18be admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.016474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.017270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.017788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.018268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.019055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.021166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.061579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1161/2326] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:09:03 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:09:04.065571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:04.079763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45955f7-a866-4f58-acfe-f46ad0432a1e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.086114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.087117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.087661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.087976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.088383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.090103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fd00c-acc2-4eac-9e6a-8783b1757726 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.103546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1166/2327] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:09:04.107745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:04.120023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d97de-f46a-462c-ad24-b35b143f9797 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.123645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.124682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.125949 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.143660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.144380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.144664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.144940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.145829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.148177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.167440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:04.168731 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:04.174515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1162/2328] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:09:04.177266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:04.201007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1167/2329] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:04.202210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb256997-16ef-4585-b398-474ce2020fb0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.207591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.208562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.208957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.209632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] PATH_INFO: `/v3/projects/2b35eb97884c4600b14718babcfb776c/users/cb76e5371d4047799080538f996aa0aa/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.222223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:04.224213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:04.232225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b35eb97884c4600b14718babcfb776c, user_id=cb76e5371d4047799080538f996aa0aa, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.235112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cfc4e-2138-4511-b499-bcac4e39bee1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.256970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1163/2330] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:09:04 2022] PUT /identity/v3/projects/2b35eb97884c4600b14718babcfb776c/users/cb76e5371d4047799080538f996aa0aa/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:09:04.329099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.329376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.329658 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.358320 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d69087-53d1-4f6b-bd04-d620da664f45 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.373685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] MFA Rules not processed for user `cb76e5371d4047799080538f996aa0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:04.374940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:04.435655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.436335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.436624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.437073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.468764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:04.482897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1164/2331] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:09:04.495861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:04.497653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:04.525364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.527150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.537522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1168/2332] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:04.550532 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:04.575523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f860a6-7430-46e6-ae18-371d07052188 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:04.580744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:04.581511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:04.581807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:04.582086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:04.592047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:04.593758 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50fd44-2e51-4a9f-90d5-404ca36fc469 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:04.603500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1165/2333] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:14.532914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=18 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:14.598748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=11 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:14.959652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:14.969475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58abae-3879-4984-aeaa-0fd45ece9eb7 service nova] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:14.974686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:14.975445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:14.975727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:14.976003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] PATH_INFO: `/v3/users/cb76e5371d4047799080538f996aa0aa` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:14.977150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb76e5371d4047799080538f996aa0aa)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:14.979103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:15.035068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb76e5371d4047799080538f996aa0aa'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.043962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb76e5371d4047799080538f996aa0aa'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.044706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb76e5371d4047799080538f996aa0aa'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.045382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb76e5371d4047799080538f996aa0aa'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.053524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb76e5371d4047799080538f996aa0aa'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.071317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1169/2334] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:09:14 2022] DELETE /identity/v3/users/cb76e5371d4047799080538f996aa0aa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:09:15.075993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:15.076287 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:15.076566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:15.095774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:15.096999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:15.157256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1166/2335] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:15.167818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:15.169226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:15.226924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fbe1c-5593-43fb-ad8f-c3b40b56c5a8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:15.230533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:15.231176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:15.231460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:15.231734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:15.240763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:15.242205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ed133-1c4a-4db6-8297-d9804c5b2cc0 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:15.251556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1170/2336] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:15.519082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:15.520600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:15.533073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee3ccf-4849-42ed-b8d4-446d8e68779c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:15.538642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:15.539432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:15.539741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:15.540001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] PATH_INFO: `/v3/projects/2b35eb97884c4600b14718babcfb776c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:15.541231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b35eb97884c4600b14718babcfb776c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:15.543177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:15.593059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b35eb97884c4600b14718babcfb776c', 'request_id': 'req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.600234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b35eb97884c4600b14718babcfb776c', 'request_id': 'req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.607927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b35eb97884c4600b14718babcfb776c', 'request_id': 'req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.619267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] The token cache is being invalidate because project 2b35eb97884c4600b14718babcfb776c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:09:15.619582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.620209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:09:15.621729 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1167/2337] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:09:15 2022] DELETE /identity/v3/projects/2b35eb97884c4600b14718babcfb776c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:09:18.553296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:18.553856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:18.553856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:18.574284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:18.575525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:18.637421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1171/2338] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:18.653670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:18.655153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:18.731377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7ab1-15e1-4692-b66f-011c46cbd01f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:18.737081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:18.737686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:18.737965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:18.738236 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:18.747610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:18.749564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89208-bca8-482f-8677-0b2d85faa541 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:18.761135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1168/2339] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:22.514182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:22.516711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:22.536252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:22.590853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e510b-a747-437b-880e-f0417a80d227 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:22.595775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:22.596389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:22.596673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:22.596978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:22.599401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:22.610441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:22.612061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:22.622436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1172/2340] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:22.761223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0b83-e540-4a86-b8fe-20a1d2f0eaa5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:22.761798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0b83-e540-4a86-b8fe-20a1d2f0eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:22.761798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0b83-e540-4a86-b8fe-20a1d2f0eaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:22.781358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-035c0b83-e540-4a86-b8fe-20a1d2f0eaa5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:22.782550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-035c0b83-e540-4a86-b8fe-20a1d2f0eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:22.790265 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1169/2341] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:22.810585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:22.823218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541122b-c0be-497c-9fb1-98a078c49635 service placement] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:22.829017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:22.829617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:22.829902 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:22.830177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:22.838381 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:22.840060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:22.849632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1173/2342] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:24.015696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a093d-1622-464c-ad14-37e0992b9748 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:24.016221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a093d-1622-464c-ad14-37e0992b9748 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:24.016313 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a093d-1622-464c-ad14-37e0992b9748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:24.024461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:24.040352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-880a093d-1622-464c-ad14-37e0992b9748 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:24.041570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-880a093d-1622-464c-ad14-37e0992b9748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:24.102017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1170/2343] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:24.125648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:24.127217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:24.197578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a033-8410-4e93-bfa4-9d56d8471965 service nova] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:24.202502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:24.203140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:24.203423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:24.203699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:24.212268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:24.213857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:24.221879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1174/2344] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:09:28.014497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d02b-8479-44e2-a2df-7510ae9a5e4c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:28.015278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d02b-8479-44e2-a2df-7510ae9a5e4c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:28.015363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d02b-8479-44e2-a2df-7510ae9a5e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:28.038015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-0915d02b-8479-44e2-a2df-7510ae9a5e4c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:28.039493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0915d02b-8479-44e2-a2df-7510ae9a5e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:28.048598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1171/2345] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:28.063683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:09:28.065205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:28.082934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3eacac-9ca7-4c36-8682-020b20efe1ad service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:09:28.093026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:09:28.093683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:28.094016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:28.094295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:28.104798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:09:28.106707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6055-d4f7-4758-9322-88fa28ec614b service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:09:28.117227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1175/2346] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:09:38.030406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=27 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:38.112175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=69 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:41.762188 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b79b6-6731-4081-8ee8-5f08796645dd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:41.762708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b79b6-6731-4081-8ee8-5f08796645dd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:41.762804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b79b6-6731-4081-8ee8-5f08796645dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:41.782178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3b6b79b6-6731-4081-8ee8-5f08796645dd None None] MFA Rules not processed for user `0f915e1541084ef88223a405a0536ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:41.783413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3b6b79b6-6731-4081-8ee8-5f08796645dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:41.839589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1172/2347] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:44.435232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:09:44.435750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:09:44.435877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:09:44.457865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] MFA Rules not processed for user `521db94671b14543a97fb5a4ef34281a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:09:44.459158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:09:44.524115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1176/2348] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:09:51.832885 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=25 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:54.518186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=25 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:01.363760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49f47-12b0-4c17-9e67-cab82b5eea33 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:01.364310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49f47-12b0-4c17-9e67-cab82b5eea33 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:01.364310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49f47-12b0-4c17-9e67-cab82b5eea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:01.383536 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2de49f47-12b0-4c17-9e67-cab82b5eea33 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:01.384657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2de49f47-12b0-4c17-9e67-cab82b5eea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:01.392556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1173/2349] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:01.407436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:01.420661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2bfd7-e561-451a-ac3a-38dcc1085b24 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:01.427603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:01.428272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:01.428561 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:01.428841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:01.437010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:01.438592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:01.448061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1177/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:10:04.599311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910845-2310-4479-a44f-0db7afe3de23 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:04.599796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910845-2310-4479-a44f-0db7afe3de23 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:04.599796 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95910845-2310-4479-a44f-0db7afe3de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:04.618798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-95910845-2310-4479-a44f-0db7afe3de23 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:04.619987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-95910845-2310-4479-a44f-0db7afe3de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:04.627788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1174/2351] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:04.642298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:04.653766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc59d56-97ef-4a58-8055-1a75e43e4fda service nova] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:04.659199 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:04.660506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:04.660712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:04.660990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:04.668940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:04.670505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:04.679821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1178/2352] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:10:07.698390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac6e4b-bc57-4233-a31a-1605a8b84c8b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:07.698943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac6e4b-bc57-4233-a31a-1605a8b84c8b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:07.699039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac6e4b-bc57-4233-a31a-1605a8b84c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:07.718406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-cdac6e4b-bc57-4233-a31a-1605a8b84c8b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:07.719649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cdac6e4b-bc57-4233-a31a-1605a8b84c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:07.729712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1175/2353] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:07.747511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:07.759869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee9a12-e97e-4733-a6e2-f24bb4edf23e service nova] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:07.765766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:07.766367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:07.766647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:07.766979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:07.775736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:07.777334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb65eb-d05e-41c2-a794-d33469d8f8a5 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:07.787091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1179/2354] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:10:11.113429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:11.113932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:11.114059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:11.134507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] MFA Rules not processed for user `071a117b156f46b0b3afb5c47b3baef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:11.135744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:11.190258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1176/2355] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:11.897415 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f666ec-80e2-48b5-a54e-d19c5f24a89c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:11.897943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f666ec-80e2-48b5-a54e-d19c5f24a89c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:11.898027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f666ec-80e2-48b5-a54e-d19c5f24a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:11.919221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-16f666ec-80e2-48b5-a54e-d19c5f24a89c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:11.920419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-16f666ec-80e2-48b5-a54e-d19c5f24a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:11.931276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1180/2356] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:11.947354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:11.961712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11677d-c2f0-4235-808c-d9c40e901aee None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:11.967503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:11.968173 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:11.968463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:11.968744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:11.978198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:11.980553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:11.993216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1177/2357] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:10:17.133332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd953a-3bb1-46d7-9a4a-7774a983c356 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:17.133983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd953a-3bb1-46d7-9a4a-7774a983c356 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:17.133983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd953a-3bb1-46d7-9a4a-7774a983c356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:17.154290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-22fd953a-3bb1-46d7-9a4a-7774a983c356 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:17.155515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-22fd953a-3bb1-46d7-9a4a-7774a983c356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:17.164325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1181/2358] 10.222.0.42 () {58 vars in 1016 bytes} [Thu Sep 22 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:17.179591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:17.190526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5886-9dee-473a-b92f-a686bf5ae45c service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:17.196595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:17.197197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:17.197480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:17.197752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:17.206174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:17.208415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab85d1-ae01-4ca3-b697-a66e7577a7aa service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:17.218124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1178/2359] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:10:22.661993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:22.662554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:22.662554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:22.681276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] MFA Rules not processed for user `071e49ba214a4ff1be50157f514fc2db`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:22.682465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:22.737057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1182/2360] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:27.213697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=46 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:32.738689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=49 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:33.850840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:33.851347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:33.851459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:33.870299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] MFA Rules not processed for user `ecffd903517544248689e4ad7a1846f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:33.871533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:33.925584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1179/2361] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:43.918725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=25 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:49.672664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:49.677235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:49.695633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0dd2d-09c2-4ac4-ac9a-87926b1700ee None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:49.700464 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:49.701726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:49.702003 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:49.702279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] PATH_INFO: `/v3/users/521db94671b14543a97fb5a4ef34281a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:49.704140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521db94671b14543a97fb5a4ef34281a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:49.706411 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:49.758049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521db94671b14543a97fb5a4ef34281a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:49.770901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521db94671b14543a97fb5a4ef34281a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:49.771533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521db94671b14543a97fb5a4ef34281a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:49.772135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521db94671b14543a97fb5a4ef34281a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:49.779663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ec74d148-66c0-4bea-85dd-b19d5b2dabc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521db94671b14543a97fb5a4ef34281a'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:49.797879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1183/2362] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:10:49 2022] DELETE /identity/v3/users/521db94671b14543a97fb5a4ef34281a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:10:49.983528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:49.998679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcae2d-3ff3-490f-8150-72ee5e6d55bc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.061429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.062056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.062335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.062605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] PATH_INFO: `/v3/projects/22535b2f30aa4e16abc31e98431b553d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.063752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22535b2f30aa4e16abc31e98431b553d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.066752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.114641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22535b2f30aa4e16abc31e98431b553d', 'request_id': 'req-aa4d7f79-913b-491d-9a54-a707700fd25c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:50.121112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22535b2f30aa4e16abc31e98431b553d', 'request_id': 'req-aa4d7f79-913b-491d-9a54-a707700fd25c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:50.128999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22535b2f30aa4e16abc31e98431b553d', 'request_id': 'req-aa4d7f79-913b-491d-9a54-a707700fd25c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:50.141647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] The token cache is being invalidate because project 22535b2f30aa4e16abc31e98431b553d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:10:50.141967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:50.142646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-aa4d7f79-913b-491d-9a54-a707700fd25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:10:50.145039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1180/2363] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:10:49 2022] DELETE /identity/v3/projects/22535b2f30aa4e16abc31e98431b553d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:10:50.150046 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.150338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.150621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.170804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:50.172032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:50.235264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1184/2364] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:50.243117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.243402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.243726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.266870 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:50.268752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:50.281097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1181/2365] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:50.282365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.292952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a9ca-3978-4f40-8901-f1438a952c57 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.297822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.298431 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.298742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.299023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.299780 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:10:50.300081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.301744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.313741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1185/2366] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:10:50.319419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.329015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c780-5492-4663-b2d1-9a11f290c53b None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.334490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.335136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.335422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.335697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.336342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.338256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb824f5-2a63-4aaf-9866-34f7c290185e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.369399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1182/2367] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:10:50.371027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.382072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b8e50-d758-4ebb-aad0-9fef53787957 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.418122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.418433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.418747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.438593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] MFA Rules not processed for user `0f915e1541084ef88223a405a0536ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:50.439834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:50.446366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.447141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.447427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.447705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.448341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.450450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.459220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:50.477640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1186/2368] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:10:50.478638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.488386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948966-d874-48e9-a469-2e6af1c62b8f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.493155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.493759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.494028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.494301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.494966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.496558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.500406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1183/2369] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:10:50.510794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1187/2370] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:10:50.512487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.526488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3bc77-0204-48a2-99e0-2287e9342cc6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.531131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.531762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.532043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.532317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.532967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.534880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e63ac-e41b-4805-aef6-d939bba23c6f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.536190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:50.547980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1184/2371] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:10:50.552167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.562179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a327-19fc-4515-abc9-666b51dd4e91 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.567587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.568258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.568544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.568825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] PATH_INFO: `/v3/projects/e7cfa103295e44de9e6ab6346c80c396/users/3afa03384cd84e40be3255e6d61594da/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.583907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cfa103295e44de9e6ab6346c80c396, user_id=3afa03384cd84e40be3255e6d61594da, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.586691 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.600753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1188/2372] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:10:50 2022] PUT /identity/v3/projects/e7cfa103295e44de9e6ab6346c80c396/users/3afa03384cd84e40be3255e6d61594da/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:10:50.605839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7171d-5220-4815-bc48-2fd15c9d31fd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.606126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7171d-5220-4815-bc48-2fd15c9d31fd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.606878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7171d-5220-4815-bc48-2fd15c9d31fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.626451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-08e7171d-5220-4815-bc48-2fd15c9d31fd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:50.627851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-08e7171d-5220-4815-bc48-2fd15c9d31fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:50.691524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1185/2373] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:10:50.701665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:50.703449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:50.771283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f54cd-ae7d-4419-9445-1d91a88c9ab4 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:50.774990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:50.775607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:50.775892 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:50.776172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:50.786662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:50.788123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:50.797858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1189/2374] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:10:55.841898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:55.842461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:55.842461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:55.872722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] MFA Rules not processed for user `3afa03384cd84e40be3255e6d61594da`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:10:55.873967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:10:55.961747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1186/2375] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:10:55.963122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:55.975477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2f8fd-e5a9-446c-9c48-201783499e34 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:55.981465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:55.982349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:55.982349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:55.982634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:55.983312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:55.985237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.025255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1190/2376] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:10:55 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:10:56.026734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:56.039878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21758ada-95d0-4788-8eb9-5fccb9e24eeb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:56.112200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:56.112835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:56.113121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:56.113399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:56.114065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:56.116096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.144075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1187/2377] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:10:56 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:10:56.147937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:56.160416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc2138-ec37-4628-bd9d-818d0aac5bc1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:56.166539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:56.167215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:56.167678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:56.168099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:56.168915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:56.170738 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.185245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1191/2378] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:10:56.190533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:56.204676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60976c-1de0-4fa4-aaeb-e92d229c45e5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:56.210354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:56.211088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:56.211372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:56.211647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] PATH_INFO: `/v3/projects/c86db5c5866f4f729d097ac4192d8f49/users/f9607b70061b403192633252ef2fe6d7/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:56.225546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:56.229100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86db5c5866f4f729d097ac4192d8f49, user_id=f9607b70061b403192633252ef2fe6d7, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:56.232420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.249119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1188/2379] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:10:56 2022] PUT /identity/v3/projects/c86db5c5866f4f729d097ac4192d8f49/users/f9607b70061b403192633252ef2fe6d7/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:10:56.255143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:56.269023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116adb7-4617-4a4e-bed2-dace3ee436c4 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:56.337783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:56.338491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:56.338886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:56.339232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:56.339947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:56.341740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613c5b8-d360-4311-aa67-7c8b5e9fff05 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.351939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1192/2380] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:10:56.356082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:10:56.366500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d1fd-c1f6-446a-a58e-30be525f6d0f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:10:56.371181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:10:56.371835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:10:56.372120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:10:56.372398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] PATH_INFO: `/v3/projects/c86db5c5866f4f729d097ac4192d8f49/users/f9607b70061b403192633252ef2fe6d7/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:10:56.374304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86db5c5866f4f729d097ac4192d8f49, user_id=f9607b70061b403192633252ef2fe6d7, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:10:56.377618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:10:56.388374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1189/2381] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:10:56 2022] PUT /identity/v3/projects/c86db5c5866f4f729d097ac4192d8f49/users/f9607b70061b403192633252ef2fe6d7/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:01.545783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee01-5290-4124-ac2f-1588be0090f4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:01.546245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee01-5290-4124-ac2f-1588be0090f4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:01.546328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7ee01-5290-4124-ac2f-1588be0090f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:01.589114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ddc7ee01-5290-4124-ac2f-1588be0090f4 None None] MFA Rules not processed for user `f9607b70061b403192633252ef2fe6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:01.590943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ddc7ee01-5290-4124-ac2f-1588be0090f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:01.606244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:01.768619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1193/2382] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:01.818258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:01.822378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:01.983182 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d9829-11ba-473f-ad1a-2158f04fe1b5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:01.995534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:01.996474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:01.996918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:01.997498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:02.117878 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:02.121340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:02.139001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1190/2383] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:03.479627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:03.480328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:03.480782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:03.508555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] MFA Rules not processed for user `3afa03384cd84e40be3255e6d61594da`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:03.510130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:03.518944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1194/2384] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:12.132786 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:13.499077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=28 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:23.615651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:23.674874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960d291-9720-402f-b4e4-745ed75e3872 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:23.678399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:23.679046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:23.679335 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:23.679612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:23.681604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:23.749567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:23.751863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:23.762457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1191/2385] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:26.907647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:26.909518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:27.010345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675464-b902-47b9-9ad7-0c86936b4ce8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.014042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.014688 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.015041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.015819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.017802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:27.033152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.035235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:27.056483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1195/2386] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:27.166135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:27.168320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:27.189764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6de502-8be5-4617-a1b5-a3689dcf79b5 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.205125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.206106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.206697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.207211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] PATH_INFO: `/v3/users/071a117b156f46b0b3afb5c47b3baef2` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.208560 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] RBAC: Authorizing `identity:delete_user(user_id=071a117b156f46b0b3afb5c47b3baef2)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.210825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:27.300139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071a117b156f46b0b3afb5c47b3baef2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.307904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071a117b156f46b0b3afb5c47b3baef2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.308621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071a117b156f46b0b3afb5c47b3baef2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.309305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071a117b156f46b0b3afb5c47b3baef2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.319023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0f0e843a-a71e-4689-920f-7319156b441d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071a117b156f46b0b3afb5c47b3baef2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.340990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1192/2387] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:27 2022] DELETE /identity/v3/users/071a117b156f46b0b3afb5c47b3baef2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:27.528781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:27.540649 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eb91c-5546-4cb4-aa88-ed27e2d2d89c service glance] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.600140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.600782 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.601070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.601352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] PATH_INFO: `/v3/projects/059acbd9ea3e4aa5863fcbac64fbecb2` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.602522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=059acbd9ea3e4aa5863fcbac64fbecb2)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.604477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:27.654942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059acbd9ea3e4aa5863fcbac64fbecb2', 'request_id': 'req-7b67f590-7fa1-4334-8fb2-735d89557f57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.662131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059acbd9ea3e4aa5863fcbac64fbecb2', 'request_id': 'req-7b67f590-7fa1-4334-8fb2-735d89557f57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.670521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059acbd9ea3e4aa5863fcbac64fbecb2', 'request_id': 'req-7b67f590-7fa1-4334-8fb2-735d89557f57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.682564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] The token cache is being invalidate because project 059acbd9ea3e4aa5863fcbac64fbecb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:27.682886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.683521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7b67f590-7fa1-4334-8fb2-735d89557f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:27.685052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1196/2388] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:27 2022] DELETE /identity/v3/projects/059acbd9ea3e4aa5863fcbac64fbecb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:27.692102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.692473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.692808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.712965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:27.714521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:27.736842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:27.784203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1193/2389] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:27.791797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.792089 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.792364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.812593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:27.813793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:27.821746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1197/2390] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:11:27.825977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:27.836056 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9b14c-3304-4cb2-9c2e-a0fbef585de4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.841033 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.841697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.841983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.842264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.843563 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:11:27.844014 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.845620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:27.857215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1194/2391] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:11:27.862142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:27.871287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de94ea-a656-4160-96ac-0d469f0b0685 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.876073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.876666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.876945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.877218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.877835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.879768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:27.907948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1198/2392] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:27 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:27.912010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:27.923471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5df81-11b2-4714-bf1e-f221ff9e8103 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:27.986955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:27.987268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:27.987625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:27.987904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:27.988548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:27.990459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:28.013022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1195/2393] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:27 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:28.017359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:28.024409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:28.029111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7433d4-4775-4064-a0b3-76205394d687 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:28.036281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:28.036967 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:28.037445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:28.038026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:28.038770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:28.040693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:28.051794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1199/2394] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:28.056082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:28.066829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac7d2c-48c4-45c2-9c4d-9b0d4e672988 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:28.071791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:28.072410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:28.073212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:28.073212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:28.073896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:28.075767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1055c2-bc0f-41d5-9285-dd1e420c9236 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:28.087727 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1196/2395] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:28.091867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:28.102645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999ff-37e1-4c4d-801c-3d05fb5e576e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:28.107209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:28.107894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:28.108176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:28.108451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] PATH_INFO: `/v3/projects/82b1c177046a4747a1879ff6d25b2c82/users/8ac5f52b7de4476aa693047f30a206b9/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:28.124512 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b1c177046a4747a1879ff6d25b2c82, user_id=8ac5f52b7de4476aa693047f30a206b9, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:28.127309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:28.141555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1200/2396] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:28 2022] PUT /identity/v3/projects/82b1c177046a4747a1879ff6d25b2c82/users/8ac5f52b7de4476aa693047f30a206b9/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:28.151854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:28.152140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:28.152416 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:28.181044 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] MFA Rules not processed for user `8ac5f52b7de4476aa693047f30a206b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:28.182250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:28.245855 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1197/2397] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:28.257753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:28.259777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:28.317309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1cff-dc3c-4a84-bffb-eabe1fcb5eed admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:28.320952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:28.321566 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:28.321851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:28.322129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:28.330595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:28.332054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:28.341396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1201/2398] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:30.213738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:30.215135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:30.237525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:30.292642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c557da-32ad-4dcf-8637-e96d3068150a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:30.299294 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:30.299910 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:30.300193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:30.300467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:30.302366 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:30.364018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:30.365671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:30.375474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1198/2399] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:31.613872 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:31.615300 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:31.674557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b27-387e-48f1-b085-17146a0f531c service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:31.678271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:31.678941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:31.679418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:31.679722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:31.681990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:31.697528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:31.699001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:31.711029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1202/2400] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:31.974924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:31.976493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:31.992081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231478-5129-4ce7-a1ab-dd6b28647d44 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:31.995926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:31.996795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:31.997077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:31.997478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:31.999922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:32.081016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:32.082573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2308c7-23ed-438f-96de-7d853ffc3c0c service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:32.094833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1199/2401] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:37.202031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:37.265819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f395-a57b-4b2c-9ebd-821114dc182a service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:37.270366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:37.271025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:37.271307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:37.271579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] PATH_INFO: `/v3/users/8ac5f52b7de4476aa693047f30a206b9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:37.272687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac5f52b7de4476aa693047f30a206b9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:37.274587 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:37.289896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:37.321346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac5f52b7de4476aa693047f30a206b9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.328158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac5f52b7de4476aa693047f30a206b9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.328923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac5f52b7de4476aa693047f30a206b9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.329558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac5f52b7de4476aa693047f30a206b9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.336529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac5f52b7de4476aa693047f30a206b9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.353950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1203/2402] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:37 2022] DELETE /identity/v3/users/8ac5f52b7de4476aa693047f30a206b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:37.358987 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:37.359494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:37.359617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:37.379201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:37.380349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:37.426277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:37.445631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1200/2403] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:37.452578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:37.453978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:37.520304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74188e-b2c0-424f-a09c-bddb5c940170 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:37.524152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:37.524550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:37.524828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:37.525839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:37.536096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:37.537548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614a33e-8228-4d80-9e75-ea7373ca230b service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:37.548246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1204/2404] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:37.821911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:37.823368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:37.836036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e3fce-3c1b-4d76-8b71-0e5a77138013 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:37.841120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:37.841913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:37.843107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:37.843721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] PATH_INFO: `/v3/projects/82b1c177046a4747a1879ff6d25b2c82` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:37.845005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b1c177046a4747a1879ff6d25b2c82)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:37.847081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:37.895892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b1c177046a4747a1879ff6d25b2c82', 'request_id': 'req-b4af62c3-3489-41c9-ac99-751bf29cebd9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.901838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b1c177046a4747a1879ff6d25b2c82', 'request_id': 'req-b4af62c3-3489-41c9-ac99-751bf29cebd9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.910129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b1c177046a4747a1879ff6d25b2c82', 'request_id': 'req-b4af62c3-3489-41c9-ac99-751bf29cebd9'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.920340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] The token cache is being invalidate because project 82b1c177046a4747a1879ff6d25b2c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:37.920849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.921596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b4af62c3-3489-41c9-ac99-751bf29cebd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:37.923171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1201/2405] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:37 2022] DELETE /identity/v3/projects/82b1c177046a4747a1879ff6d25b2c82 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:37.928265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:37.928672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:37.929128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:37.949797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:37.951153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:38.011840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1205/2406] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:11:38.020826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.021243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.021605 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.042494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:38.043718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:38.052109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1202/2407] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:38.056630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.066929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936ae44-1ef5-4faa-bc4a-85d62c8c4e80 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.072103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.072701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.072980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.073254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.073897 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:11:38.074205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.075852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.088401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1206/2408] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:11:38.093682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.103047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b986dc-0194-4a36-95c3-d0a1482559af None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.107868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.108708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.108994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.109274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.109925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.111863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.144984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1203/2409] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:38.146303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.157541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2462-e45d-44a6-8d60-29eb24944514 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.177992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:38.218418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.219067 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.219379 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.219652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.220272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.222724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.248850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1207/2410] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:38.250064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.260697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a08e-da77-4172-a921-73efdb0d7aa5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.265863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.266457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.266761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.267058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.267695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.269275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.282320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1204/2411] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:38.283589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.293925 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d50e5-6a6c-4185-9a3d-98d62efdf9dc admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.298718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.299391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.299739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.300101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.300802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.302454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b16c4c-a9d0-45cf-812e-d781d9c4abc8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.313744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1208/2412] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:38.318140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.328714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7abe09-1480-48e9-8d0c-8a92834b197d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.335675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.336535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.337167 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.337470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] PATH_INFO: `/v3/projects/c8d40d677a4243b385381f5a8f59371a/users/d32bcd5b2e6b45a384576914b3f995a8/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.353685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d40d677a4243b385381f5a8f59371a, user_id=d32bcd5b2e6b45a384576914b3f995a8, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.356511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.370415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1205/2413] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:38 2022] PUT /identity/v3/projects/c8d40d677a4243b385381f5a8f59371a/users/d32bcd5b2e6b45a384576914b3f995a8/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:38.381438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.381708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.381984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.410019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] MFA Rules not processed for user `d32bcd5b2e6b45a384576914b3f995a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:38.411196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:38.474266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1209/2414] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:38.478821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.543632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefd43f-1864-4858-bbad-e2637eecae53 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.549644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.550288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.550616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.550940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.551584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.553626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.572606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:38.587197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1206/2415] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:38.591301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.602231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c724572-1662-4c53-bd3f-6e2d65b33a95 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.663701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.664255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.664532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.664803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.665438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.667369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.691122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1210/2416] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:11:38.695214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.706086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5bab-6aae-4834-a31c-c4c2aa30cdda admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.711010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.711624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.711906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.712180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.712849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.714445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.725719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1207/2417] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:38.730035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.742461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba83e6c-36ae-4a5a-a2f3-e04758f55cd5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.747457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.748118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.748958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.749330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] PATH_INFO: `/v3/projects/3e993b13b7334010ab537a84936a2fc1/users/807ef93d3be547b697ff1cf973fb5668/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.766428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e993b13b7334010ab537a84936a2fc1, user_id=807ef93d3be547b697ff1cf973fb5668, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.769220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.777913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:38.783866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1211/2418] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:38 2022] PUT /identity/v3/projects/3e993b13b7334010ab537a84936a2fc1/users/807ef93d3be547b697ff1cf973fb5668/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:38.788562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.801866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02f28e-1f7c-438b-b9c0-2462e883f605 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.872564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.873179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.873620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.873898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.874599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.878166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5d1ff-0cb9-4715-9a5c-267d6b45b656 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.893506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1208/2419] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:38.894648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:38.906400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cec1b-b8cb-4be5-9f31-86832100c139 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:38.911006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:38.911656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.911940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.912218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] PATH_INFO: `/v3/projects/3e993b13b7334010ab537a84936a2fc1/users/807ef93d3be547b697ff1cf973fb5668/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.914151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e993b13b7334010ab537a84936a2fc1, user_id=807ef93d3be547b697ff1cf973fb5668, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:38.916769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:38.927144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1212/2420] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:38 2022] PUT /identity/v3/projects/3e993b13b7334010ab537a84936a2fc1/users/807ef93d3be547b697ff1cf973fb5668/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:38.939641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:38.940068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:38.940358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:38.970068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] MFA Rules not processed for user `807ef93d3be547b697ff1cf973fb5668`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:38.971327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:39.058450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1209/2421] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:39.071014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:39.072719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:39.147047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37d0d4-03e7-44b3-9c35-9c3e72e45520 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:39.151823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:39.152454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:39.152747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:39.153018 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:39.163201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:39.164705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fcc83-49c5-4eb2-9745-d14f35988e66 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:39.175239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1213/2422] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:39.608336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:39.695363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c5179-0df3-4bbf-b334-4a6cd2a798be None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:39.700266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:39.700961 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:39.701322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:39.701747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] PATH_INFO: `/v3/users/d32bcd5b2e6b45a384576914b3f995a8` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:39.703031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32bcd5b2e6b45a384576914b3f995a8)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:39.704959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:39.710740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:39.756483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32bcd5b2e6b45a384576914b3f995a8'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:39.767117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32bcd5b2e6b45a384576914b3f995a8'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:39.768055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32bcd5b2e6b45a384576914b3f995a8'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:39.768825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32bcd5b2e6b45a384576914b3f995a8'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:39.776376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32bcd5b2e6b45a384576914b3f995a8'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:39.794807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1210/2423] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:39 2022] DELETE /identity/v3/users/d32bcd5b2e6b45a384576914b3f995a8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:39.799951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:39.800418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:39.800514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:39.820708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:39.821933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:39.891286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1214/2424] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:11:39.900972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:39.902390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:39.964352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1f6d0-16be-4575-a65b-d95211d14f42 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:39.968684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:39.969346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:39.969636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:39.970145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:39.980421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:39.981879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:39.993347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1211/2425] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:40.286011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:40.287511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:40.301122 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28124f33-830c-43d0-b81d-9b01331741aa None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:40.305807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:40.306440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:40.306777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:40.307064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] PATH_INFO: `/v3/projects/c8d40d677a4243b385381f5a8f59371a` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:40.308220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d40d677a4243b385381f5a8f59371a)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:40.310204 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:40.356877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d40d677a4243b385381f5a8f59371a', 'request_id': 'req-74f9d523-97c5-42be-9983-9a06278e01a2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.363603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d40d677a4243b385381f5a8f59371a', 'request_id': 'req-74f9d523-97c5-42be-9983-9a06278e01a2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.371073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d40d677a4243b385381f5a8f59371a', 'request_id': 'req-74f9d523-97c5-42be-9983-9a06278e01a2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.382338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] The token cache is being invalidate because project c8d40d677a4243b385381f5a8f59371a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:40.382631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.383279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.384991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1215/2426] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:40 2022] DELETE /identity/v3/projects/c8d40d677a4243b385381f5a8f59371a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:40.389660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:40.399254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d64e5-baa4-4f88-97b4-bd51e99daa31 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:40.436249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:40.437708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:40.452800 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:40.459999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:40.460648 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:40.460931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:40.461207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] PATH_INFO: `/v3/users/807ef93d3be547b697ff1cf973fb5668` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:40.462336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807ef93d3be547b697ff1cf973fb5668)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:40.464398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:40.495273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:40.516883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807ef93d3be547b697ff1cf973fb5668'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.523391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9d523-97c5-42be-9983-9a06278e01a2 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:40.525278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807ef93d3be547b697ff1cf973fb5668'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.525993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807ef93d3be547b697ff1cf973fb5668'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.526627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807ef93d3be547b697ff1cf973fb5668'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.529401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:40.530155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:40.530446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:40.530753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:40.532507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:40.534001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807ef93d3be547b697ff1cf973fb5668'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:40.551873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1212/2427] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:40 2022] DELETE /identity/v3/users/807ef93d3be547b697ff1cf973fb5668 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:40.600047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:40.602124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4462c2-2832-4139-ab05-5e1ba2dbe2fe service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:40.612870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1216/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:11:40.896819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:40.898558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:40.981725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065426b-24d5-42b3-a0f6-3c0709c11a65 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:40.986954 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:40.987589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:40.987873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:40.988147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] PATH_INFO: `/v3/projects/3e993b13b7334010ab537a84936a2fc1` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:40.989283 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e993b13b7334010ab537a84936a2fc1)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:40.991214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.038943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e993b13b7334010ab537a84936a2fc1', 'request_id': 'req-2a8c746f-3612-4925-8d9e-cb2324831483'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:41.045697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e993b13b7334010ab537a84936a2fc1', 'request_id': 'req-2a8c746f-3612-4925-8d9e-cb2324831483'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:41.052925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e993b13b7334010ab537a84936a2fc1', 'request_id': 'req-2a8c746f-3612-4925-8d9e-cb2324831483'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:41.063887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] The token cache is being invalidate because project 3e993b13b7334010ab537a84936a2fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:41.064181 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:41.064845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a8c746f-3612-4925-8d9e-cb2324831483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:41.066364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1213/2429] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:40 2022] DELETE /identity/v3/projects/3e993b13b7334010ab537a84936a2fc1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:11:41.071225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.071722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.071845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.091202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:41.092410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:41.150461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1217/2430] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:41.158594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.158914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.159194 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.179031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:41.180232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:41.188100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1214/2431] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:41.192284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.203228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a6e08-a0fc-4cc8-a30f-42bd87aa6f3a None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.209938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.210554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.210866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.211146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.211794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:11:41.212105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.213737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.229664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1218/2432] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:11:41.230782 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.241275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ecb5-094e-455d-8111-36dbd29358bc None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.246036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.246641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.246957 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.247233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.247896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.250052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.280315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1215/2433] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:11:41.284283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.297666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65e99-8669-4d0a-88e5-f7bd3a0ab3c7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.331079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:41.356914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.357571 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.357853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.358124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.358789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.361203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.386230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1219/2434] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:41.387434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.398222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b26ff-af11-440e-9f01-e3e2623474da admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.405947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.406552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.406869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.407141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.407780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.409365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.410717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:41.426742 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1216/2435] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:41.426900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.437113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f026ce-cf85-4fb6-ac65-77cdc712c20e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.442630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.443268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.443664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.443808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.444446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.446030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d509e6-d323-4804-aa7f-8b5449f54c8d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.463836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1220/2436] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:41.466320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.480149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c8dd0-f8fa-46a1-9c8e-9aadacdbc528 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.485837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.486489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.486802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.487130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] PATH_INFO: `/v3/projects/b7bf15f925054f6a86892b5c009363af/users/6ee5ea7bf8c24827bf282961f75cb63b/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.502172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf15f925054f6a86892b5c009363af, user_id=6ee5ea7bf8c24827bf282961f75cb63b, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.504839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.518150 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1217/2437] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:41 2022] PUT /identity/v3/projects/b7bf15f925054f6a86892b5c009363af/users/6ee5ea7bf8c24827bf282961f75cb63b/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:41.529080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.529936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.530220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.559128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] MFA Rules not processed for user `6ee5ea7bf8c24827bf282961f75cb63b`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:41.560517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:41.628248 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1221/2438] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:41.632813 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.701042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b158b80-6630-413c-ae77-0a0b736a73da admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.706838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.707451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.707732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.708006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.709031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.711500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.741079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1218/2439] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:11:41.745163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.756421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeee0-75bd-4c82-abd8-0ba71c9dea65 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.818955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.819866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.819866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.820173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.820916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.822944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.846801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1222/2440] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:41 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:41.850537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.869371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68f7d-161a-47cb-9030-400ccfe3f710 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.875565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.875780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.876192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.876541 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.877258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.878963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.893454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1219/2441] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:41.894974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.906031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e82120-c609-4dd7-8b9b-fd0b85bae4d6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:41.910692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:41.912054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:41.912343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:41.912626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] PATH_INFO: `/v3/projects/423996c60aee4dc582a5a2a612a1f7e1/users/6c48e330cb854962adb62fb0acd715f2/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:41.929350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423996c60aee4dc582a5a2a612a1f7e1, user_id=6c48e330cb854962adb62fb0acd715f2, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:41.932094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:41.945994 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1223/2442] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:41 2022] PUT /identity/v3/projects/423996c60aee4dc582a5a2a612a1f7e1/users/6c48e330cb854962adb62fb0acd715f2/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:41.949993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:41.961800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9741bb5-f0e3-4690-b7bc-e901cf57545e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:42.022240 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:42.022896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:42.023172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:42.023451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:42.024097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:42.025720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d69ef-3cb6-4246-9cce-a119d941106d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:42.036097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1220/2443] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:42.040226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:42.051351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006823-230a-4322-a660-0cd2fbf6d2a7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:42.056039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:42.056694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:42.056980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:42.057257 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] PATH_INFO: `/v3/projects/423996c60aee4dc582a5a2a612a1f7e1/users/6c48e330cb854962adb62fb0acd715f2/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:42.059193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=423996c60aee4dc582a5a2a612a1f7e1, user_id=6c48e330cb854962adb62fb0acd715f2, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:42.061865 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:42.064982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:42.073538 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1224/2444] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:42 2022] PUT /identity/v3/projects/423996c60aee4dc582a5a2a612a1f7e1/users/6c48e330cb854962adb62fb0acd715f2/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:42.084896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:42.085184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:42.085458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:42.114222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] MFA Rules not processed for user `6c48e330cb854962adb62fb0acd715f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:42.115472 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:42.146117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:42.187575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1221/2445] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:42.198777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:42.200795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:42.259518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18a9a-a477-460a-a5e9-0660b1fb3b33 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:42.263136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:42.263851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:42.264203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:42.264549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:42.273725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:42.275266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7086af-d67d-4dce-b8fc-78541949d049 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:42.285144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1225/2446] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:42.361050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:42.370680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6639dd-6ceb-4040-ba30-9bbcefd049c5 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:42.374347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:42.374969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:42.375253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:42.375527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:42.431999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:42.433441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:42.442431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1222/2447] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:50.462389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:50.462927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:50.463022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:50.483870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:50.485101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:50.550077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1226/2448] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:50.600233 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:50.601673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:50.675734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc69a64-80c1-4155-9514-cd555fa8e666 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:50.681455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:50.682110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:50.682554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:50.682834 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:50.692531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:50.694733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:50.704279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1223/2449] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:11:51.055237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:51.056811 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:51.157306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f688-84a7-49ec-875f-ffb4f1d80732 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:51.161651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:51.162739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:51.163101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:51.163478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:51.165690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:51.266243 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:51.273540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:51.275914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:51.287166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1227/2450] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:52.961273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:52.962953 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:53.088495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:53.117836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d34b40-331d-4c53-a83e-99abe9f279b9 service swift] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:53.133889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:53.134543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:53.134858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:53.140618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:53.143644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:53.251873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:53.254076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:53.284314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1224/2451] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:55.839476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:55.841725 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:55.856862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d7bd-0a35-4791-8484-9326c9d8a91d service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:55.861988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:55.862936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:55.863400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:55.864154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] PATH_INFO: `/v3/users/ecffd903517544248689e4ad7a1846f7` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:55.865140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecffd903517544248689e4ad7a1846f7)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:55.867282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:55.931665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecffd903517544248689e4ad7a1846f7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:55.943880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecffd903517544248689e4ad7a1846f7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:55.944573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecffd903517544248689e4ad7a1846f7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:55.945208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecffd903517544248689e4ad7a1846f7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:55.953042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64f2634a-6107-48d6-a643-05b44cec42e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecffd903517544248689e4ad7a1846f7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:55.984627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1228/2452] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:55 2022] DELETE /identity/v3/users/ecffd903517544248689e4ad7a1846f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:56.198108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:56.212271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca1d6-59e0-4205-a6f7-e266354f8987 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:56.300371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:56.301025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.301309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.301639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] PATH_INFO: `/v3/projects/91830b00885e45d386f1842186cd2df3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.302983 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91830b00885e45d386f1842186cd2df3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:56.304974 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:56.367196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91830b00885e45d386f1842186cd2df3', 'request_id': 'req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:56.374489 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91830b00885e45d386f1842186cd2df3', 'request_id': 'req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:56.383942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91830b00885e45d386f1842186cd2df3', 'request_id': 'req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:56.396318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] The token cache is being invalidate because project 91830b00885e45d386f1842186cd2df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:56.396702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:56.397427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2f367a1b-d695-4e63-9af7-c84f5e7d9fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:56.405373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1225/2453] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:56 2022] DELETE /identity/v3/projects/91830b00885e45d386f1842186cd2df3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:56.405611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.405611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.405611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.442452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:56.443700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:56.521104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1229/2454] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:56.529132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.529420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.529701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.559876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:56.561136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:56.570408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1226/2455] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:56.574637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:56.585441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6dd08-d117-490d-b677-2d57f18e52b1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:56.603049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:56.604076 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.604581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.605080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.605812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:11:56.606244 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:56.608198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:56.622793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1230/2456] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:11:56.634247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:56.644615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a601a-4b10-4797-b163-ab14927137d5 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:56.664219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:56.664833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.665145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.665385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.666031 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:56.671081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:56.722866 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:56.759534 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1227/2457] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:11:56 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:56.764763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:56.779249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdac99-8add-44d7-ba53-2c49c6063ec7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:56.870267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:56.891965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:56.893393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.893841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.894168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.894862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:56.897163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:56.947866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1231/2458] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:11:56 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:11:56.952045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:56.967790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259e9ae-416d-414f-bdf4-69a532a811f9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:56.973419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:56.984135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:56.984792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:56.985327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:56.986213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:56.989057 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:57.003120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1228/2459] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:11:57.006901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:57.018361 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011ba5-1f7f-4f03-9fc8-e9f9ea6a24ef admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:57.026514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:57.027167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:57.027452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:57.027729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:57.029013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:57.030698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7b91e-0824-4f8b-8ba4-d160d20349c8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:57.048273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1232/2460] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:11:57.052389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:57.073644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfe6c2-fc80-4842-976a-51f2b18ac164 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:57.087602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:57.088559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:57.089128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:57.089618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] PATH_INFO: `/v3/projects/3a7dc9f2d1874bae8b9a935d0b799e1d/users/33aaff956632461b82ed0f7fb9c8a138/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:57.115355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7dc9f2d1874bae8b9a935d0b799e1d, user_id=33aaff956632461b82ed0f7fb9c8a138, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:57.118303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:57.134861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1229/2461] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:11:57 2022] PUT /identity/v3/projects/3a7dc9f2d1874bae8b9a935d0b799e1d/users/33aaff956632461b82ed0f7fb9c8a138/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:57.145033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:57.145324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:57.145608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:57.179024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] MFA Rules not processed for user `33aaff956632461b82ed0f7fb9c8a138`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:57.180477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:57.265080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1233/2462] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:57.278162 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:57.279901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:57.383862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3892-1f75-482a-8983-937ad16cc809 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:57.391917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:57.392838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:57.393118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:57.393557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:57.404637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:57.406976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d2650-d6b6-44fa-ad46-df4ab5140ecf service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:57.420992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1230/2463] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:58.761275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:58.763568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:58.864764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed47d4a-5072-4b3b-af48-683a0a42d9c8 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:58.869885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:58.870626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:58.871008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:58.871356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] PATH_INFO: `/v3/users/6ee5ea7bf8c24827bf282961f75cb63b` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:58.872937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee5ea7bf8c24827bf282961f75cb63b)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:58.874982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:58.938139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee5ea7bf8c24827bf282961f75cb63b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:58.947467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee5ea7bf8c24827bf282961f75cb63b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:58.948225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee5ea7bf8c24827bf282961f75cb63b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:58.948954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee5ea7bf8c24827bf282961f75cb63b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:58.959864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee5ea7bf8c24827bf282961f75cb63b'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:58.961424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:59.000095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1234/2464] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:58 2022] DELETE /identity/v3/users/6ee5ea7bf8c24827bf282961f75cb63b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:59.004631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:59.005572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:59.006030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:59.035055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:11:59.036540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:59.116289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1231/2465] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:11:59.127013 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:59.128578 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:59.231787 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03b9b2-2c7b-4bfa-9e2a-3674a90a047d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:59.236910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:59.237638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:59.238010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:59.238287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:59.262815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:59.264747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:59.287468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1235/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:11:59.780575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:59.782312 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:11:59.801325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77349f0c-f5b7-4399-94ec-6976a423e185 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:11:59.817621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:11:59.818548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:11:59.819060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:11:59.819336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] PATH_INFO: `/v3/projects/b7bf15f925054f6a86892b5c009363af` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:11:59.821172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bf15f925054f6a86892b5c009363af)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:11:59.823210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:11:59.905525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:59.918103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bf15f925054f6a86892b5c009363af', 'request_id': 'req-6e5d6af2-1d06-42ac-8218-5b0036f78191'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:59.930356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bf15f925054f6a86892b5c009363af', 'request_id': 'req-6e5d6af2-1d06-42ac-8218-5b0036f78191'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:59.939046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bf15f925054f6a86892b5c009363af', 'request_id': 'req-6e5d6af2-1d06-42ac-8218-5b0036f78191'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:59.954994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] The token cache is being invalidate because project b7bf15f925054f6a86892b5c009363af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:11:59.955232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:59.955882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:11:59.957584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1232/2467] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:11:59 2022] DELETE /identity/v3/projects/b7bf15f925054f6a86892b5c009363af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:11:59.961689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:11:59.973540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf99f29-a910-4e5e-84a4-bc140f16687e service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:00.063608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:00.064298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.064582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.064855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] PATH_INFO: `/v3/users/6c48e330cb854962adb62fb0acd715f2` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.066531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c48e330cb854962adb62fb0acd715f2)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:00.068222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:00.138831 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c48e330cb854962adb62fb0acd715f2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.155237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c48e330cb854962adb62fb0acd715f2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.155870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c48e330cb854962adb62fb0acd715f2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.156539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c48e330cb854962adb62fb0acd715f2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.164908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-4dd0f0f2-c583-40bb-bd3f-3d6d442b05c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c48e330cb854962adb62fb0acd715f2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.188621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1236/2468] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:11:59 2022] DELETE /identity/v3/users/6c48e330cb854962adb62fb0acd715f2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:00.507803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:00.510065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:00.526847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d6af2-1d06-42ac-8218-5b0036f78191 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:00.614567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:00.615262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.615546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.615873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] PATH_INFO: `/v3/projects/423996c60aee4dc582a5a2a612a1f7e1` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.617017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423996c60aee4dc582a5a2a612a1f7e1)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:00.619141 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:00.689230 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423996c60aee4dc582a5a2a612a1f7e1', 'request_id': 'req-7e047a5a-b0ab-494d-90d4-b115619dd402'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.701911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423996c60aee4dc582a5a2a612a1f7e1', 'request_id': 'req-7e047a5a-b0ab-494d-90d4-b115619dd402'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.714329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423996c60aee4dc582a5a2a612a1f7e1', 'request_id': 'req-7e047a5a-b0ab-494d-90d4-b115619dd402'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.729542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] The token cache is being invalidate because project 423996c60aee4dc582a5a2a612a1f7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:00.729838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.730722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7e047a5a-b0ab-494d-90d4-b115619dd402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:00.732190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1233/2469] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:00 2022] DELETE /identity/v3/projects/423996c60aee4dc582a5a2a612a1f7e1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:00.737249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.737540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.737821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.749401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:00.766436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:00.768284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:00.848277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1237/2470] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:00.849960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.850226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.850503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.874980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:00.876207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:00.886737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1234/2471] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:00.890475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:00.904480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad5d85-bdab-4378-9f97-3ad6067cacbc None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:00.909969 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:00.910630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.910954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.911236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.912149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:00.912462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:00.914083 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:00.932336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1238/2472] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:00.937152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:00.961550 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0559c2-b733-4263-8a63-8af01728931a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:00.971277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:00.972097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:00.972455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:00.972794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:00.973498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:00.979323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.062903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1235/2473] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:00 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:01.064397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.077156 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efd0f6-2469-4e52-9587-0fbd8946b1c6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.186973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.187640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.187896 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.189944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.189944 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.202182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.238692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1239/2474] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:01 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:01.239763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.255596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35111-7e70-425c-979f-997a757b25a2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.261009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.261562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.261873 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.262152 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.263302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.265118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.278911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1236/2475] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:01.286091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.301225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556044c-8252-4dd4-bd22-c93d505f9faf admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.308524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.309972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.309972 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.310394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.311221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.312993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950edfa6-37c8-4b83-aafc-e7cc871f181d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.328472 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1240/2476] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:01.331664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.351028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df395f-7e9b-4109-aeca-fc795ff8479d admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.358559 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.360263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.361842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.362237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] PATH_INFO: `/v3/projects/e7e55417e2744f23a2dd240eb7e8be95/users/25e7fa0617704d82a109979fe3db18a3/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.387566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e55417e2744f23a2dd240eb7e8be95, user_id=25e7fa0617704d82a109979fe3db18a3, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.390804 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.397299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:01.412336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1237/2477] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:01 2022] PUT /identity/v3/projects/e7e55417e2744f23a2dd240eb7e8be95/users/25e7fa0617704d82a109979fe3db18a3/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:01.424364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.424927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.425414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.467027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] MFA Rules not processed for user `25e7fa0617704d82a109979fe3db18a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:01.468529 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:01.564395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:01.576625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.577568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1241/2478] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:01.672221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785f9f5-b0ef-49fa-bd99-f275b66c520f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.678387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.679079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.679412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.679694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.680372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.682397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.726723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1238/2479] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:01 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:01.726958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.757734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657933e-96b9-4e21-942e-1e58448a33c3 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.839534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.841069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.841377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.841769 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.842420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.844458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.883681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1242/2480] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:01 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:01.884938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.896653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12a49e-b997-46de-a7c4-1138c7da0c9b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.913798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.914615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.915028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.915405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.916163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.917917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.930295 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1239/2481] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:01.934262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:01.944879 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6930b61-6964-4a23-a233-4d7ecb1cc4aa admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:01.951056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:01.951931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:01.952222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:01.952505 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] PATH_INFO: `/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee/users/9668111b772b4ab79dee15e129353a47/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:01.971682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7208f4f8b1694aa3a4745a0f5603aeee, user_id=9668111b772b4ab79dee15e129353a47, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:01.974976 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:01.999664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1243/2482] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:01 2022] PUT /identity/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee/users/9668111b772b4ab79dee15e129353a47/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:02.004762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.020863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08296fd9-3ec4-47ce-91b0-3ae9be22f962 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:02.107567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:02.108322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.108612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.108924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.109602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:02.112445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c8bc-1826-4549-976f-bfeb1db6ead1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:02.141628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1240/2483] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:02.142856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.160631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed26f1-9348-4ed0-8a4f-4ec441c4aa4f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:02.171272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:02.172111 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.172496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.172943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] PATH_INFO: `/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee/users/9668111b772b4ab79dee15e129353a47/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.175153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7208f4f8b1694aa3a4745a0f5603aeee, user_id=9668111b772b4ab79dee15e129353a47, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:02.177938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:02.195369 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1244/2484] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:02 2022] PUT /identity/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee/users/9668111b772b4ab79dee15e129353a47/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:02.206982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.207409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.207790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.270396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] MFA Rules not processed for user `9668111b772b4ab79dee15e129353a47`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:02.272426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:02.384002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:02.431904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1241/2485] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:02.452812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.456187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:02.515307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.517509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:02.571159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e77e4-b437-40e8-a320-970703335922 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:02.575984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:02.576619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.576904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.577279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.595807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:02.597380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:02.638260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1245/2486] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:02.645708 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afdec1-0ca2-46e0-938d-ba7fa245e2a3 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:02.654574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:02.655348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.655699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.655992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] PATH_INFO: `/v3/users/33aaff956632461b82ed0f7fb9c8a138` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.657200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33aaff956632461b82ed0f7fb9c8a138)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:02.661785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:02.757189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.764168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33aaff956632461b82ed0f7fb9c8a138'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:02.773086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a971e-d7c0-4b46-996b-0759c0513da8 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:02.792295 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:02.792941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:02.793792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:02.794075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:02.804582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33aaff956632461b82ed0f7fb9c8a138'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:02.810668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33aaff956632461b82ed0f7fb9c8a138'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:02.813329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33aaff956632461b82ed0f7fb9c8a138'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:02.824906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33aaff956632461b82ed0f7fb9c8a138'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:02.850440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1242/2487] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:02 2022] DELETE /identity/v3/users/33aaff956632461b82ed0f7fb9c8a138 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:02.852172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:02.854101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:02.900080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:02.924269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:02.925926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ad27d-e4f4-4c3e-8416-cb720e1bb3ef service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:03.002142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1246/2488] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:03.003582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.003875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.004170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:03.040981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:03.042155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:03.078007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c2ca-898e-4017-9921-40dcbc5a21c8 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:03.104362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:03.104991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.105270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.106060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:03.116215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:03.140913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1247/2489] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:03.147214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:03.149905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:03.153344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:03.156483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:03.158422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:03.189248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1243/2490] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:03.327936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f4f0-b361-4000-8858-c9176db8f64b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:03.331852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:03.332625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.333008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.333382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:03.344553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:03.346222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d558be-5038-4f27-bf60-a04ec295cff2 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:03.357492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1248/2491] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:03.765582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:03.768110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:03.789383 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26727e-802a-42c9-97d9-b1c40aad4760 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:03.794524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:03.795266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.795567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.795805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] PATH_INFO: `/v3/projects/3a7dc9f2d1874bae8b9a935d0b799e1d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:03.797085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7dc9f2d1874bae8b9a935d0b799e1d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:03.799370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:03.851455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7dc9f2d1874bae8b9a935d0b799e1d', 'request_id': 'req-0eed0acf-66b3-4495-a85c-d037dbedc227'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:03.858858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7dc9f2d1874bae8b9a935d0b799e1d', 'request_id': 'req-0eed0acf-66b3-4495-a85c-d037dbedc227'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:03.869471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7dc9f2d1874bae8b9a935d0b799e1d', 'request_id': 'req-0eed0acf-66b3-4495-a85c-d037dbedc227'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:03.881980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] The token cache is being invalidate because project 3a7dc9f2d1874bae8b9a935d0b799e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:03.882543 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:03.883382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-0eed0acf-66b3-4495-a85c-d037dbedc227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:03.884915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1244/2492] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:03 2022] DELETE /identity/v3/projects/3a7dc9f2d1874bae8b9a935d0b799e1d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:03.890850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.891233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.891592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:03.913077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:03.914308 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:03.977690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1249/2493] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:03.985649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:03.986175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:03.986642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.004489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.005899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:04.008899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:04.010128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:04.020341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1245/2494] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:04.025008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.034826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827614c-cfe7-4856-ae45-5b92ad243bbf None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.040300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.041458 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.041970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.042316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.043623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:04.044001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.046008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.057376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:04.066211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1246/2495] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:12:04.067148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.078805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b5fd9-71de-4239-b46f-6266643a53f4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.079503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460ab6-1c63-41f2-9c00-dd452b1c01a5 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.083247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.083542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.083995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.084191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.084298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.084479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.084586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.084751 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.085336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.086484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:04.087290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.098056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.099540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.109118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1250/2496] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:04.120027 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1247/2497] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:04 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:04.124521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.143037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe26247-77c7-47b6-a188-0caa7347031e service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.205470 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.206088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.206368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.206646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.207335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.209330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.232618 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1251/2498] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:04 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:04.236812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.247614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de062f-e69a-455b-a4c7-5ea432047cb7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.252301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.252902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.253183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.253456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.254094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.255721 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.267204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1248/2499] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:04.271288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.282559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f78ebe-bbd7-48db-9b3f-0556f3eba3ee admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.287815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.288916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.288916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.289117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.289681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.291344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88a1ab-6422-4a1a-813f-36e455d77e98 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.302752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1252/2500] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:04.307581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.321420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af0e8c-8db5-4654-81e7-a94d870ad5cd admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.334839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.335521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.335908 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.336209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] PATH_INFO: `/v3/projects/3177920c454448719247c1ba6bff044a/users/5532355211464a87b399542f72622df2/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.352872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3177920c454448719247c1ba6bff044a, user_id=5532355211464a87b399542f72622df2, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.356478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.381621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1249/2501] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:04 2022] PUT /identity/v3/projects/3177920c454448719247c1ba6bff044a/users/5532355211464a87b399542f72622df2/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:04.384264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.384628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.384916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.416116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] MFA Rules not processed for user `5532355211464a87b399542f72622df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:04.417342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:04.519543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1253/2502] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:04.528412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:04.530370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:04.613521 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:04.636222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a4e75-02ab-404d-825a-e8a738700e69 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:04.644077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:04.644930 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:04.645668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:04.646047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:04.663595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:04.667041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:04.681329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1250/2503] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:07.078148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:07.104155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb1c99-54e1-44bf-a6ee-0289643055d9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:07.124559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:07.124559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:07.124857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:07.124857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:07.133684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:07.148666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:07.150271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc35043-1a3d-4f62-b14e-e36c1e768919 service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:07.162501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1254/2504] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:07.503780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:07.568459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd342-7ee4-456d-9440-746d0978e6d6 service nova] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:07.573417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:07.574239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:07.574531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:07.574828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] PATH_INFO: `/v3/users/5532355211464a87b399542f72622df2` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:07.576075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5532355211464a87b399542f72622df2)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:07.577972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:07.628767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5532355211464a87b399542f72622df2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:07.636980 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5532355211464a87b399542f72622df2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:07.637745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5532355211464a87b399542f72622df2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:07.638422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5532355211464a87b399542f72622df2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:07.646562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5532355211464a87b399542f72622df2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:07.665584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1251/2505] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:07 2022] DELETE /identity/v3/users/5532355211464a87b399542f72622df2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:07.671194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8b89-061d-45ea-9927-5cc929dffb16 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:07.671492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8b89-061d-45ea-9927-5cc929dffb16 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:07.671771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8b89-061d-45ea-9927-5cc929dffb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:07.691852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-21db8b89-061d-45ea-9927-5cc929dffb16 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:07.693276 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-21db8b89-061d-45ea-9927-5cc929dffb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:07.722889 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:07.760355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1255/2506] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:07.771798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:07.773438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:07.837570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6f161-863e-4acd-bc04-bed63aae8bec admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:07.842542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:07.843199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:07.843441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:07.843714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:07.855488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:07.857345 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:07.868296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1252/2507] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:08.209393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732031-49de-4b6b-9265-0eca29494f3a None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.209849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732031-49de-4b6b-9265-0eca29494f3a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.209952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a732031-49de-4b6b-9265-0eca29494f3a None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.212910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1256/2508] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:12:08.213837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.215959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.221593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.221961 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.222239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.238098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641c9b-68ae-4d1d-8294-1b974ac6027f service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.254132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.254869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.255164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.255455 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] PATH_INFO: `/v3/projects/3177920c454448719247c1ba6bff044a` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.261310 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3177920c454448719247c1ba6bff044a)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.263805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.265757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:08.290406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:08.291933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.375820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3177920c454448719247c1ba6bff044a', 'request_id': 'req-450586dc-7703-4224-9b1c-159c5b0ab305'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:08.383671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3177920c454448719247c1ba6bff044a', 'request_id': 'req-450586dc-7703-4224-9b1c-159c5b0ab305'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:08.394076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3177920c454448719247c1ba6bff044a', 'request_id': 'req-450586dc-7703-4224-9b1c-159c5b0ab305'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:08.405770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] The token cache is being invalidate because project 3177920c454448719247c1ba6bff044a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:08.406266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:08.407045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-450586dc-7703-4224-9b1c-159c5b0ab305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:08.414476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1253/2509] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:08 2022] DELETE /identity/v3/projects/3177920c454448719247c1ba6bff044a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:08.426306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790c1e-26b7-4c05-9348-cde611710534 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.429136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790c1e-26b7-4c05-9348-cde611710534 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.429136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef790c1e-26b7-4c05-9348-cde611710534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.429371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1257/2510] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:08.446645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.448218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.454009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ef790c1e-26b7-4c05-9348-cde611710534 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:08.455395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ef790c1e-26b7-4c05-9348-cde611710534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.521149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4fa0d-2349-4e35-8060-2af819e8bf3c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.534750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1254/2511] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:08.542414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.543241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.543697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.565117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:08.566354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.574898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1255/2512] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:08.579285 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.588973 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.589626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.590072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.590357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.590947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf536181-28fb-4c89-90dc-5c6b19af2144 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.595913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.596524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.596837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.597110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.597814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:08.598148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.599799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.616603 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1256/2513] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:12:08.617593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.628700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fd98e-a17c-47cd-a199-0bf12e3ac355 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.633896 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.634590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.634936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.635192 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.635673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:08.635884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.637844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.672991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1257/2514] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:08.674907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.676139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.677804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb04d7-34ff-4237-a838-8b7e79be8c91 service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.692179 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1258/2515] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:08.728468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:08.744009 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a57-647a-4ab4-902e-415683b58bed admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.749359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.749971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.750260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.750595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.751209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.753133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.766263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b3d25-0c26-4c51-a0ec-c515e69381a7 None None] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.766613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b3d25-0c26-4c51-a0ec-c515e69381a7 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.766946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b3d25-0c26-4c51-a0ec-c515e69381a7 None None] PATH_INFO: `/` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.768560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1259/2516] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 17:12:08.774398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.774628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.774934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.780847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1258/2517] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:08.784756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.795308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36281b-91b6-43a1-8822-da59c0d783ea admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.800342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] MFA Rules not processed for user `72ddabdd350b45c68233ea757a6aec54`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:08.801050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.801662 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.801788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.801960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.802206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.802899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.804660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.816267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1259/2518] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:08.820374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.831043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdc82-1b92-4bb2-9a13-788a8f329d20 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.835770 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.836356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.836644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.836919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.837590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.839203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.853368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1260/2519] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:08.854151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1260/2520] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:08.854277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.866058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ac35a-e01f-4251-8b9a-0452faa5dedf admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.866847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:08.868218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.871330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.872270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.872552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.872826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] PATH_INFO: `/v3/projects/fe8ffc4bd5254e2cbfaa0d7b982fea69/users/3cd75cfecaaa4475b57ec958b2c8e9e3/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.879315 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049d84-729d-479b-9794-2020a22b9109 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:08.883629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:08.884231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.884515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.884789 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.888470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8ffc4bd5254e2cbfaa0d7b982fea69, user_id=3cd75cfecaaa4475b57ec958b2c8e9e3, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.891245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2d7f6-0087-4a61-ab4f-49349f2cc322 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.892535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:08.893953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03083be-56fc-424b-a59c-77e73d37f7ef service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:08.903220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1261/2521] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:08.908832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1261/2522] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:08 2022] PUT /identity/v3/projects/fe8ffc4bd5254e2cbfaa0d7b982fea69/users/3cd75cfecaaa4475b57ec958b2c8e9e3/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:08.921670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.922053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.922402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:08.951095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] MFA Rules not processed for user `3cd75cfecaaa4475b57ec958b2c8e9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:08.952342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:08.998072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4306-129f-4a9a-be64-3df43528ca9c None None] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:08.998364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4306-129f-4a9a-be64-3df43528ca9c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:08.998669 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce4306-129f-4a9a-be64-3df43528ca9c None None] PATH_INFO: `/` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.000010 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1262/2523] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 22 17:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 17:12:09.005449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.006013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.006382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.020819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1262/2524] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:09.025458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.029151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] MFA Rules not processed for user `8bddbf2c5a23405bb4ae9c56e9b17d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:09.030374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.078611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:09.094537 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a08c-e0dd-419b-b905-4e29588a5f97 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.099236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.099849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.100131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.100410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.101038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.102199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1263/2525] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 22 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:09.103107 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.113654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.136794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1263/2526] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:09 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:09.137744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.177935 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5f5d2-f893-4ae3-adf2-2400ba6e8db2 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.228371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:09.248919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.249561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.249854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.250130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.344741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce10a-b7a0-47fc-b5fa-9bea57ec58e9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.346765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.348334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.350235 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.351064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.351406 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.351744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.352501 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.355038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.360776 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1264/2527] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:09.379575 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1264/2528] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:09 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:09.384595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.399905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bc9c0-9f81-44f3-9987-8689a946908d service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.407417 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.408369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.409117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.409577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.409863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.410627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.411646 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.412682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.424332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30276719-8b52-40c9-83b2-a58f8a598772 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.425048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1265/2529] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:09.429110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.429651 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.430327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.430777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.431095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] PATH_INFO: `/v3/users/25e7fa0617704d82a109979fe3db18a3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.432253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e7fa0617704d82a109979fe3db18a3)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.435028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.440449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bca577-b8ba-47e9-b469-c48e5e94bd42 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.446956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.447722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.448072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.448353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] PATH_INFO: `/v3/projects/dea37ae9b9c24fc0933c082704c5d50d/users/8367c0d403e647d5917a5f2a016b6e96/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.467787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea37ae9b9c24fc0933c082704c5d50d, user_id=8367c0d403e647d5917a5f2a016b6e96, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.470526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.485318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1266/2530] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:09 2022] PUT /identity/v3/projects/dea37ae9b9c24fc0933c082704c5d50d/users/8367c0d403e647d5917a5f2a016b6e96/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:09.486275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.488015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.492443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e7fa0617704d82a109979fe3db18a3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:09.500577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e7fa0617704d82a109979fe3db18a3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:09.501659 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e7fa0617704d82a109979fe3db18a3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:09.502461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e7fa0617704d82a109979fe3db18a3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:09.512732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e7fa0617704d82a109979fe3db18a3'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:09.536555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1265/2531] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:09 2022] DELETE /identity/v3/users/25e7fa0617704d82a109979fe3db18a3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:09.539753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.541442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.595126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa3e1-7fcc-40c8-8e46-c70640446303 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.599422 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:09.638518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219220ed-fe02-45b4-8d50-2b16f7c73b9e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.644085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.644803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.645153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.645493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.646210 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.647921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369f588-2210-4e48-855e-0d734e7334c8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.666078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1266/2532] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:09.666078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.666078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.666078 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.670153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:09.685344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:09.686548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.690039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.690720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.691124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.691406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.693146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.694596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1267/2533] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:09.695513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.706823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8e4f3-752e-47c2-8aed-b3d126ad4f84 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.709330 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.710964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.712223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.712877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.713162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.713438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] PATH_INFO: `/v3/projects/dea37ae9b9c24fc0933c082704c5d50d/users/8367c0d403e647d5917a5f2a016b6e96/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.716844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea37ae9b9c24fc0933c082704c5d50d, user_id=8367c0d403e647d5917a5f2a016b6e96, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.719386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.721282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1267/2534] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:09.722133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.723511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.731305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1268/2535] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:09 2022] PUT /identity/v3/projects/dea37ae9b9c24fc0933c082704c5d50d/users/8367c0d403e647d5917a5f2a016b6e96/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:09.735519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:09.741469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.788483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132c328-93a5-4498-8d7f-fe413c7568aa service placement] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.815292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a626-340b-487a-8310-f61e73c721d9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:09.820355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.820975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.821260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.821878 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.847114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:09.847806 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.848148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.848495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.851116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.894545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.896137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11889-d092-4441-9024-ef6102af70b7 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.908962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1269/2536] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:09.910334 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:09.910676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:09.910941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:09.941435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:09.943738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:09.948488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] MFA Rules not processed for user `8367c0d403e647d5917a5f2a016b6e96`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:09.950453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:09.962390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1268/2537] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:10.033978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:10.069759 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1270/2538] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:10.078108 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:10.080069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:10.136596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:10.148487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a27d4-e019-47c7-b428-e13ff2373b0b service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:10.155100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:10.155859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:10.156171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:10.156523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:10.166738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:10.169160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:10.180488 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1269/2539] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:10.300446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:10.320019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba700b41-471a-4f62-9272-76455a45b3ed None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:10.324246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:10.324890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:10.325176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:10.325498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:10.327430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:10.404490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:10.405796 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:10.416590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1271/2540] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:10.461030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:10.462704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:10.490950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a8280-4c84-44f1-8fef-6ebd173803d4 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:10.498165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:10.498964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:10.499315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:10.499801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] PATH_INFO: `/v3/projects/e7e55417e2744f23a2dd240eb7e8be95` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:10.501317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e55417e2744f23a2dd240eb7e8be95)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:10.503899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:10.562171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e55417e2744f23a2dd240eb7e8be95', 'request_id': 'req-04cfc5ff-3764-4930-a5f2-f3179c06f16a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.568838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e55417e2744f23a2dd240eb7e8be95', 'request_id': 'req-04cfc5ff-3764-4930-a5f2-f3179c06f16a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.577364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e55417e2744f23a2dd240eb7e8be95', 'request_id': 'req-04cfc5ff-3764-4930-a5f2-f3179c06f16a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.590963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] The token cache is being invalidate because project e7e55417e2744f23a2dd240eb7e8be95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:10.591275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.591948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.593675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1270/2541] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:10 2022] DELETE /identity/v3/projects/e7e55417e2744f23a2dd240eb7e8be95 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:10.598397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:10.612700 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33463fc-5452-4851-a104-9588821e6d74 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:10.687959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:10.688951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:10.689183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:10.689640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] PATH_INFO: `/v3/users/9668111b772b4ab79dee15e129353a47` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:10.695052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9668111b772b4ab79dee15e129353a47)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:10.697510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:10.757402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9668111b772b4ab79dee15e129353a47'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.780845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9668111b772b4ab79dee15e129353a47'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.782094 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9668111b772b4ab79dee15e129353a47'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.782951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9668111b772b4ab79dee15e129353a47'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.795064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-81a20bd0-7c40-4de9-8fc6-19e45f0dc472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9668111b772b4ab79dee15e129353a47'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:10.817678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1272/2542] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:10 2022] DELETE /identity/v3/users/9668111b772b4ab79dee15e129353a47 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:11.478976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:11.481591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:11.499001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfc5ff-3764-4930-a5f2-f3179c06f16a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:11.572440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:11.573105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:11.573451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:11.573907 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] PATH_INFO: `/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:11.575179 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7208f4f8b1694aa3a4745a0f5603aeee)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:11.577209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:11.632756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7208f4f8b1694aa3a4745a0f5603aeee', 'request_id': 'req-f9137a1e-6973-4c69-b9d2-bf48772ccde7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:11.639772 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7208f4f8b1694aa3a4745a0f5603aeee', 'request_id': 'req-f9137a1e-6973-4c69-b9d2-bf48772ccde7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:11.648433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7208f4f8b1694aa3a4745a0f5603aeee', 'request_id': 'req-f9137a1e-6973-4c69-b9d2-bf48772ccde7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:11.657977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:11.662391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] The token cache is being invalidate because project 7208f4f8b1694aa3a4745a0f5603aeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:11.663103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:11.664457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f9137a1e-6973-4c69-b9d2-bf48772ccde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:11.668080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1271/2543] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:11 2022] DELETE /identity/v3/projects/7208f4f8b1694aa3a4745a0f5603aeee => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:11.674162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:11.674698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:11.674845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:11.686066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:11.697809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:11.699808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:11.766573 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1273/2544] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:11.777530 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:11.778480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:11.778480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:11.799377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:11.800594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:11.809576 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1272/2545] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:11.814237 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:11.824833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21a95-647e-4d64-ad59-ebe81aa660a6 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:11.829497 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:11.830178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:11.830533 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:11.830903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:11.831617 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:11.831999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:11.833654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:11.846534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1274/2546] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:11.851590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:11.861168 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bb20-4ef8-4865-ae27-8244e0ed0382 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:11.879995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:11.880633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:11.887663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:11.888006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:11.888685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:11.891374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c951-08c1-405c-8cec-cf0deeaf1c57 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:11.967995 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1273/2547] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:11 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:11.968432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:11.999101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6e6f5-d7ae-447e-8dd2-39848756065b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.027231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.027948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.028698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.062791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:12.064309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:12.119803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.123601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.123887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.124164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.125108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.128056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.172282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1275/2548] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:11 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:12.173761 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.190106 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec6b22-7623-46ed-bc8a-a6d138d0cdb9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.195697 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.196299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.196583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.196855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.197502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.200585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.219650 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1276/2549] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:12.224064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.238299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b0738-2632-43f5-9789-a37bd7ff755e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.239651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1274/2550] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:12.247124 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.248701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:12.253517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.254915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.255311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.255689 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.256444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.260368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.280285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1277/2551] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:12.285611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.301398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67897205-059d-4c05-8ca4-df3c5ae65ef4 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.311574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.312586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.313085 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.313489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] PATH_INFO: `/v3/projects/07fe23eb9d8645f1ab3df2910e3363d2/users/ff4721c76ca84bfab4ce77ff4541707b/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.339457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fe23eb9d8645f1ab3df2910e3363d2, user_id=ff4721c76ca84bfab4ce77ff4541707b, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.341639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c499be-112a-43a1-b3d5-75963b0044a2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.360773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1278/2552] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:12 2022] PUT /identity/v3/projects/07fe23eb9d8645f1ab3df2910e3363d2/users/ff4721c76ca84bfab4ce77ff4541707b/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:12.373131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.373490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.373828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.393867 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6597-e232-43eb-aba0-a5da85c5bf9a None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.411103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] MFA Rules not processed for user `ff4721c76ca84bfab4ce77ff4541707b`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:12.412353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:12.443860 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:12.485792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.486615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.486927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.487250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.500071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1279/2553] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:12.504920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.517697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:12.578694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.580633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.588174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba43f6-dbd5-4d86-9f4c-a7a97db0f8ec None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.593591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.594212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.594492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.594810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.609027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.611486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.613695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1275/2554] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 17:12:12.675020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1280/2555] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:12 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:12.677140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.688426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a47189-4498-4c11-8c4f-67ab7f8a01e5 service swift] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.786478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.787250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.787544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.787875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.788827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.790785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.825619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1276/2556] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:12 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:12.828644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.845466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9191802-0c33-40e4-b3ab-2eb385c6b903 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.857791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.858428 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.858739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.859016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.860719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.864539 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:12.891432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1281/2557] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:12.896830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:12.911984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a1b7-a07e-4b08-91d3-fd26b034c937 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:12.919564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:12.920798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:12.921340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:12.922085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] PATH_INFO: `/v3/projects/990f3545a7af44edb912b107874dcbc9/users/6a1a326e76314e9c88bd4dab12b8beb5/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:12.945291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=990f3545a7af44edb912b107874dcbc9, user_id=6a1a326e76314e9c88bd4dab12b8beb5, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:12.970395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:13.012128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1277/2558] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:12 2022] PUT /identity/v3/projects/990f3545a7af44edb912b107874dcbc9/users/6a1a326e76314e9c88bd4dab12b8beb5/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:13.016768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:13.031099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a48a8-9e9b-44c4-bad7-6f34a548cade admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:13.131247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:13.131247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.131247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.131247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.132001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:13.134854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755ec07-4359-4362-9cc1-e9063c8d7573 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:13.161197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1282/2559] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:13.165611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:13.188531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ff2b-4de4-4115-97a7-ed1faa346c1f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:13.215273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:13.219602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.220769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.221706 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] PATH_INFO: `/v3/projects/990f3545a7af44edb912b107874dcbc9/users/6a1a326e76314e9c88bd4dab12b8beb5/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.228449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990f3545a7af44edb912b107874dcbc9, user_id=6a1a326e76314e9c88bd4dab12b8beb5, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:13.236336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:13.257665 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1278/2560] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:13 2022] PUT /identity/v3/projects/990f3545a7af44edb912b107874dcbc9/users/6a1a326e76314e9c88bd4dab12b8beb5/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:13.269716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.270383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.271022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.340326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] MFA Rules not processed for user `6a1a326e76314e9c88bd4dab12b8beb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:13.341557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:13.346243 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:13.348043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:13.403730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:13.485135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53791c52-c1b7-42bd-ad23-fd6e1c315b05 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:13.492890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:13.494316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.494830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.495828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] PATH_INFO: `/v3/users/3cd75cfecaaa4475b57ec958b2c8e9e3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.497568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd75cfecaaa4475b57ec958b2c8e9e3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:13.500114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:13.519769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:13.533942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1283/2561] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:13.556559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:13.560344 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:13.592116 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd75cfecaaa4475b57ec958b2c8e9e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:13.609733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd75cfecaaa4475b57ec958b2c8e9e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:13.610385 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd75cfecaaa4475b57ec958b2c8e9e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:13.611038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd75cfecaaa4475b57ec958b2c8e9e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:13.626750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-69e747f2-9012-4570-bf73-3f2a9a8ae380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd75cfecaaa4475b57ec958b2c8e9e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:13.668781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1279/2562] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:13 2022] DELETE /identity/v3/users/3cd75cfecaaa4475b57ec958b2c8e9e3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:13.699347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.701937 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.702232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.744389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:13.746513 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:13.768075 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32649d-4919-4d51-8178-430e5ce57061 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:13.872414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1280/2563] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:13.891827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:13.893787 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:13.978803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:13.979629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:13.980115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:13.992507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:13.999031 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:14.068028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f9c48-ae29-4985-a76e-8870b2701b5c None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:14.079400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:14.080317 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:14.080677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:14.082412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:14.130608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:14.134171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:14.156377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:14.157914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee8546-a2f2-4b5a-a62c-1cf8aa5a42e4 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:14.175019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1281/2564] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:14.194558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1284/2565] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:14.262147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:14.264306 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:14.294519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418eac-42ee-48d9-a7ba-a86bdad68520 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:14.304445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:14.305649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:14.306088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:14.306539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] PATH_INFO: `/v3/users/ff4721c76ca84bfab4ce77ff4541707b` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:14.321564 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4721c76ca84bfab4ce77ff4541707b)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:14.327292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:14.416651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:14.446531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4721c76ca84bfab4ce77ff4541707b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:14.466799 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4721c76ca84bfab4ce77ff4541707b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:14.467531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4721c76ca84bfab4ce77ff4541707b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:14.475291 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4721c76ca84bfab4ce77ff4541707b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:14.493391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4721c76ca84bfab4ce77ff4541707b'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:14.520548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1282/2566] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:14 2022] DELETE /identity/v3/users/ff4721c76ca84bfab4ce77ff4541707b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:14.525712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:14.527437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:14.528348 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:14.560461 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:14.563033 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:14.621579 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:14.784483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1285/2567] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:14.794990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:14.796506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:14.918694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4f51-9410-44a6-bd9d-b91b36ce497c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:14.924947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:14.926064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:14.926528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:14.927892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:14.947450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:14.950390 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:14.963705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1283/2568] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:15.224150 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:15.226255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:15.250866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280fa07-7e81-4fc6-ab40-8fd3eb08bc90 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:15.264526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:15.266736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:15.290698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:15.292837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:15.299342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0a965-19ae-4aa0-b4aa-a77fec563464 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:15.299968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:15.300432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] PATH_INFO: `/v3/users/0f915e1541084ef88223a405a0536ffc` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:15.306628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f915e1541084ef88223a405a0536ffc)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:15.317988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:15.322468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:15.324362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:15.325158 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:15.325732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] PATH_INFO: `/v3/projects/fe8ffc4bd5254e2cbfaa0d7b982fea69` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:15.330447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8ffc4bd5254e2cbfaa0d7b982fea69)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:15.335029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:15.426637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f915e1541084ef88223a405a0536ffc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.441253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f915e1541084ef88223a405a0536ffc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.441881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f915e1541084ef88223a405a0536ffc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.442490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f915e1541084ef88223a405a0536ffc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.454899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f915e1541084ef88223a405a0536ffc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.486853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8ffc4bd5254e2cbfaa0d7b982fea69', 'request_id': 'req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.487814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1286/2569] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:15 2022] DELETE /identity/v3/users/0f915e1541084ef88223a405a0536ffc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:15.509384 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8ffc4bd5254e2cbfaa0d7b982fea69', 'request_id': 'req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.524765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8ffc4bd5254e2cbfaa0d7b982fea69', 'request_id': 'req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.538854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] The token cache is being invalidate because project fe8ffc4bd5254e2cbfaa0d7b982fea69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:15.539588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.540457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.542524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1284/2570] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:15 2022] DELETE /identity/v3/projects/fe8ffc4bd5254e2cbfaa0d7b982fea69 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:15.546829 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:15.548272 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:15.644434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71f51-3471-4809-bab9-6f4ce57e3504 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:15.655360 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:15.656343 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:15.656676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:15.656963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] PATH_INFO: `/v3/users/8367c0d403e647d5917a5f2a016b6e96` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:15.658338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8367c0d403e647d5917a5f2a016b6e96)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:15.661250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:15.665902 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:15.668249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:15.736340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:15.747601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:15.753703 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8367c0d403e647d5917a5f2a016b6e96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.770254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8367c0d403e647d5917a5f2a016b6e96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.771202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8367c0d403e647d5917a5f2a016b6e96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.772217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8367c0d403e647d5917a5f2a016b6e96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.799631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8367c0d403e647d5917a5f2a016b6e96'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:15.829314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1287/2571] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:15 2022] DELETE /identity/v3/users/8367c0d403e647d5917a5f2a016b6e96 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:15.850505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64fbfa-0074-45e4-9c2b-4c65f80428d7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:15.886622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:15.888959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.000641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.001392 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.001746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.002112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] PATH_INFO: `/v3/projects/07fe23eb9d8645f1ab3df2910e3363d2` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.003481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fe23eb9d8645f1ab3df2910e3363d2)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.006296 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.064594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a389-b896-4235-864e-21a8bb7441b0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.104800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fe23eb9d8645f1ab3df2910e3363d2', 'request_id': 'req-29c39fa4-7322-4171-a74d-d782eb54b915'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.117928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fe23eb9d8645f1ab3df2910e3363d2', 'request_id': 'req-29c39fa4-7322-4171-a74d-d782eb54b915'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.160092 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fe23eb9d8645f1ab3df2910e3363d2', 'request_id': 'req-29c39fa4-7322-4171-a74d-d782eb54b915'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.190307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] The token cache is being invalidate because project 07fe23eb9d8645f1ab3df2910e3363d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:16.190601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.193106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.197525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1285/2572] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:15 2022] DELETE /identity/v3/projects/07fe23eb9d8645f1ab3df2910e3363d2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:16.199034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.199836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.200171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.201412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.202063 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] PATH_INFO: `/v3/projects/96a82f69df524ab9977f54bbed079c56` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.203700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.206011 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a82f69df524ab9977f54bbed079c56)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.209225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.232456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c39fa4-7322-4171-a74d-d782eb54b915 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.244847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.246585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.247580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.248387 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] PATH_INFO: `/v3/users/6a1a326e76314e9c88bd4dab12b8beb5` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.252203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1a326e76314e9c88bd4dab12b8beb5)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.255469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.325207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a82f69df524ab9977f54bbed079c56', 'request_id': 'req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.351483 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a82f69df524ab9977f54bbed079c56', 'request_id': 'req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.361055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1a326e76314e9c88bd4dab12b8beb5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.376191 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a82f69df524ab9977f54bbed079c56', 'request_id': 'req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.377684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1a326e76314e9c88bd4dab12b8beb5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.378425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1a326e76314e9c88bd4dab12b8beb5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.379164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1a326e76314e9c88bd4dab12b8beb5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.392368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1a326e76314e9c88bd4dab12b8beb5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.395637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:16.398005 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:16.423307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] The token cache is being invalidate because project 96a82f69df524ab9977f54bbed079c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:16.424926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.426439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d91e9a66-a83e-4d4d-bc16-1042c87d8a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.432957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1288/2573] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:15 2022] DELETE /identity/v3/projects/96a82f69df524ab9977f54bbed079c56 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:16.435059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ad44-5437-4191-98f9-c19c28c978ad None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.435521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ad44-5437-4191-98f9-c19c28c978ad None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.435966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ad44-5437-4191-98f9-c19c28c978ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.438364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1286/2574] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:16 2022] DELETE /identity/v3/users/6a1a326e76314e9c88bd4dab12b8beb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:16.439429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.442388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.460223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8fd7ad44-5437-4191-98f9-c19c28c978ad None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:16.461718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8fd7ad44-5437-4191-98f9-c19c28c978ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.546755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1289/2575] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:16.548473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.551451 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.551732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.602584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671efec4-b631-45e8-afc8-4666a05f34df admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.611219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.612311 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.612831 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.613372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] PATH_INFO: `/v3/projects/dea37ae9b9c24fc0933c082704c5d50d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.615218 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea37ae9b9c24fc0933c082704c5d50d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.618851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.644432 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:16.650767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.677724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1290/2576] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:16.682545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.697148 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea37ae9b9c24fc0933c082704c5d50d', 'request_id': 'req-169782dc-0eb3-49fe-bba2-f8b3c839cad2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.708266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630c12-45ed-4c24-9c85-01e2dc4ed909 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.711190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea37ae9b9c24fc0933c082704c5d50d', 'request_id': 'req-169782dc-0eb3-49fe-bba2-f8b3c839cad2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.722129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea37ae9b9c24fc0933c082704c5d50d', 'request_id': 'req-169782dc-0eb3-49fe-bba2-f8b3c839cad2'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.744900 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] The token cache is being invalidate because project dea37ae9b9c24fc0933c082704c5d50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:16.745473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.746745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-169782dc-0eb3-49fe-bba2-f8b3c839cad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:16.749280 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1287/2577] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:16 2022] DELETE /identity/v3/projects/dea37ae9b9c24fc0933c082704c5d50d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:16.754587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f8fc-049d-40cc-bc6c-60b4308d0cc6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.754967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f8fc-049d-40cc-bc6c-60b4308d0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.755314 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983f8fc-049d-40cc-bc6c-60b4308d0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.798510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-b983f8fc-049d-40cc-bc6c-60b4308d0cc6 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:16.799793 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-b983f8fc-049d-40cc-bc6c-60b4308d0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.841574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.842963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.844576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.845019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.845974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:16.846744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.848652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.865822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1291/2578] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:16.870105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.872349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.889126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9421-32cb-43b3-b989-58ae56afc450 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.891155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1288/2579] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:16.893884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:16.894503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.894819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.895090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.895350 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:16.895641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:16.895868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:16.895985 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:16.898412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:16.944164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:16.946613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:16.953684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1292/2580] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:16.957528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.966422 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1289/2581] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:16.967626 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:16.993064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d38bd-9e45-4165-b360-2fe3c415ff34 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:16.999474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:17.087016 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170ab96-3411-4778-88dc-e40b8177c7f0 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.093173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.094166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.094531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.094988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.095911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.098289 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.117895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.118691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.119036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.119398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.120817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:17.121490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.123343 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.130447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:17.146329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1290/2582] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:17.149802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.149802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.158181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1293/2583] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:16 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:17.160373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.165106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbcd87-9454-4956-9e73-117757fed4d1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.171325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.172094 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.172448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.172728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] PATH_INFO: `/v3/projects/990f3545a7af44edb912b107874dcbc9` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.173865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=990f3545a7af44edb912b107874dcbc9)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.176221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.179909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbe20-44ee-4dc2-87a7-cfc6921bc6d8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.190730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.191768 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.192202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.194607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.196061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.201239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.261891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1294/2584] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:17.261891 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.274231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990f3545a7af44edb912b107874dcbc9', 'request_id': 'req-c45f1289-fd98-407a-8747-9d89258efe9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:17.291015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990f3545a7af44edb912b107874dcbc9', 'request_id': 'req-c45f1289-fd98-407a-8747-9d89258efe9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:17.309712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990f3545a7af44edb912b107874dcbc9', 'request_id': 'req-c45f1289-fd98-407a-8747-9d89258efe9c'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:17.330029 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] The token cache is being invalidate because project 990f3545a7af44edb912b107874dcbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:17.330334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:17.334073 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:17.335840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1291/2585] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:17 2022] DELETE /identity/v3/projects/990f3545a7af44edb912b107874dcbc9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:17.340924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.343007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.376991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e74c8-788d-475e-a47e-f0a96e2d0c4c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.383615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.386530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.386921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.387440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.388404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.390908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60303c06-3d41-4108-97a0-202ab1e4e843 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.410453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1295/2586] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:17.412055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.412349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.412632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.429989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1289-fd98-407a-8747-9d89258efe9c admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.436322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.436948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.437231 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.437502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.438139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.440213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.443576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:17.444804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.454138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1296/2587] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:17.455202 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.456712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.494133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2c6a-5be7-46c8-a5b0-eaa39db46b12 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.512439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.513134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.513421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.513751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.517693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.517693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c145-8703-4715-a7e9-1d0bbdcd10e0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.519145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1292/2588] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:17.521818 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.538194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1297/2589] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:17.539722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.540015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.540290 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.547423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4215b76-db9c-494b-aee7-c30e77609413 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.560490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.561491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.563382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.563774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.564696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.566430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.574909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:17.576176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.587355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1293/2590] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:17.587355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.595464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:17.603104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1298/2591] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:17.604722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.605835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831409-5cfc-4d7f-a1b0-12a4f40017bd admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.616627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.617402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.617756 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.618176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] PATH_INFO: `/v3/projects/85ba7080e13748458d7b21dff2afeeed/users/43803f6bf3e7410887d67f08ca09048c/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.618518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b557095-3ae8-4217-b26d-feaddea37afa None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.625309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.626259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.626814 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.627309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.628165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.630058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.641812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ba7080e13748458d7b21dff2afeeed, user_id=43803f6bf3e7410887d67f08ca09048c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.648486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1299/2592] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:17.649393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.650684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.662187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c479-42a6-4f74-ba87-1711c4d5e710 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.672066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.672929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.673152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.673426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.676367 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:17.676816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.679525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda2e1c-6f35-43db-80e5-c9cf6b8508dd admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.681101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1294/2593] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:17 2022] PUT /identity/v3/projects/85ba7080e13748458d7b21dff2afeeed/users/43803f6bf3e7410887d67f08ca09048c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:17.686901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.697449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1300/2594] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:17.699206 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.699503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.699763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.746370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] MFA Rules not processed for user `43803f6bf3e7410887d67f08ca09048c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:17.748066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:17.803712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ef06-42a7-4ccd-a154-52441388c372 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.821797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.823110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.823406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.823690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] PATH_INFO: `/v3/projects/20da78bd5ff14716aa388d89deadffde/users/889a9bd770a44d6ba7f9d800b45b79c6/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.864034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1301/2595] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:17.865862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.878496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a9dec-6a27-40b9-a135-80345e526ee9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:17.883628 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20da78bd5ff14716aa388d89deadffde, user_id=889a9bd770a44d6ba7f9d800b45b79c6, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.883816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:17.884492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:17.884850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:17.885197 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:17.886574 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:17.886909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.888783 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:17.893815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:17.923113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1302/2596] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:17.924128 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.925288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1295/2597] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:17 2022] PUT /identity/v3/projects/20da78bd5ff14716aa388d89deadffde/users/889a9bd770a44d6ba7f9d800b45b79c6/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:17.927207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:17.935777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:18.064973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba5349-5cfd-4ca1-8d1f-253b7d21a1f0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.067390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1b05f-8030-4a8f-8885-adc2ec7c9f8e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.089755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.090480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.090844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.091117 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.170081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.170876 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.171234 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.171512 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.172478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.175337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa7db-b0f2-4938-a4e9-fc538a45ae7a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.200502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.210642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1296/2598] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:17 2022] POST /identity/v3/users => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:18.212657 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.213292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.215201 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.255607 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] MFA Rules not processed for user `889a9bd770a44d6ba7f9d800b45b79c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:18.257380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:18.258336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.260177 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.273135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1303/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:18.286708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.304287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b38fb-1d20-4a0c-96d8-57f20586ceef service nova] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.309753 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.310498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.310913 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.311261 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.311983 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.313658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.330407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1304/2600] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:18.332055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.355275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95e46f-2333-4e06-b01a-cec7a451185e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.355275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.356287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.356626 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.357021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.357743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.359471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.376601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1305/2601] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:18.384383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.395862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f738a6f-f9c0-4198-8f2d-7a14f347a8c7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.406162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.406985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.407426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.407665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] PATH_INFO: `/v3/projects/e42af6a6a18c41e5934221179ec76afd/users/34e978fc712e4dedbdcf84db3a2658e2/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.413887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1297/2602] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:18.419686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.439116 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42af6a6a18c41e5934221179ec76afd, user_id=34e978fc712e4dedbdcf84db3a2658e2, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.442091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be917067-3329-47e5-bd42-00365b154afe admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.450780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e32d2-42c7-40be-9a9e-87b4ac73bfd7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.470862 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1306/2603] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:18 2022] PUT /identity/v3/projects/e42af6a6a18c41e5934221179ec76afd/users/34e978fc712e4dedbdcf84db3a2658e2/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:18.471525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.471525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.471525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.471525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.471921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.471921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.478054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.478413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.478779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.521919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] MFA Rules not processed for user `34e978fc712e4dedbdcf84db3a2658e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:18.523452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:18.536491 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1298/2604] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:18.538123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.571665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.650881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1307/2605] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:18.653040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.696085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c170c8-05fd-452d-a83e-9a765f717be3 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.709063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.709686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.710045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.710341 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.711006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.713040 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.748888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1299/2606] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:18.748888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.750946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682297-fe3a-4a12-b354-e6ddbb277653 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.762200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb876-263c-4e6d-9472-3277307e92ab admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.764165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.764854 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.765142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.766109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] PATH_INFO: `/v3/users/43803f6bf3e7410887d67f08ca09048c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.767488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] RBAC: Authorizing `identity:delete_user(user_id=43803f6bf3e7410887d67f08ca09048c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.771576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.780939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:18.782195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:18.782668 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:18.783153 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:18.783979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:18.786903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:18.836547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1300/2607] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:18.837391 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.862423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43803f6bf3e7410887d67f08ca09048c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:18.870370 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43803f6bf3e7410887d67f08ca09048c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:18.871819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43803f6bf3e7410887d67f08ca09048c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:18.872466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43803f6bf3e7410887d67f08ca09048c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:18.880827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43803f6bf3e7410887d67f08ca09048c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:18.887554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.911778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1308/2608] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:18 2022] DELETE /identity/v3/users/43803f6bf3e7410887d67f08ca09048c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:18.911778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:18.911778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:18.926516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5fbac-f2a9-4bc7-b7dd-9a2c44474fe4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:18.967446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:19.001685 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c529e1-deef-4c54-bd38-480f23f396af admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.002893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.003837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.004223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.004602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.005578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.006802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.007435 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.007717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.007989 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.008142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b6533-7795-42b1-9ff8-a6f043c40c94 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.008612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.010781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.023331 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1301/2609] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:19.025427 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.025723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.026574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.045686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1309/2610] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:18 2022] POST /identity/v3/users => generated 306 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:19.045686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.046036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.049993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:19.051241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.063380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1302/2611] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:19.063380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.071644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd8b7-2d83-4f02-b4a2-aa580a047b70 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.073442 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54240869-e6dc-4130-8fa3-38d0689f5b35 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.077955 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.078854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.079238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.079621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.080275 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.080464 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.081004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.081340 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.081669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] PATH_INFO: `/v3/projects/14b2754d00ae4f899b181f1ff70c40c9/users/190e671a77354ac588108d5063fce511/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.082463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.096372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1303/2612] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:19.097410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.099264 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.117715 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b2754d00ae4f899b181f1ff70c40c9, user_id=190e671a77354ac588108d5063fce511, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.122250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.152647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1310/2613] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:19 2022] PUT /identity/v3/projects/14b2754d00ae4f899b181f1ff70c40c9/users/190e671a77354ac588108d5063fce511/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:19.153992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.203790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9ba9-86cb-46aa-b37e-1c170918c885 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.285540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1d7b-ef06-4b52-bf29-89b611e06bea admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.296874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.297868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.298189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.298553 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.298857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.299130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] PATH_INFO: `/v3/projects/71f7dd917f3a46a18363c174d47e3c45/users/c598d337b5ae4b6687212dc051c7f553/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.299525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.300086 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.312506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.314922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.316565 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f7dd917f3a46a18363c174d47e3c45, user_id=c598d337b5ae4b6687212dc051c7f553, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.319277 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.329249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1304/2614] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:19.330920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.344775 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98544bbb-03f5-4897-8565-2e70671e3e7d service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.348511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1311/2615] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:19 2022] PUT /identity/v3/projects/71f7dd917f3a46a18363c174d47e3c45/users/c598d337b5ae4b6687212dc051c7f553/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:19.349741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.368689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=100 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:19.492166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8d4f-a123-44bb-a6bf-4b010c3248a9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.499581 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.500327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.500869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.501007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.501132 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.501743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.502006 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.502189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.502436 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.503208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.504024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.505110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.520356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1305/2616] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:19.523677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.524510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1312/2617] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:19.529255 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.538493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8183bd-17d4-4ab9-b031-495bcb7d9f39 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.545071 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.545883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.546184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.546547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] PATH_INFO: `/v3/projects/14b2754d00ae4f899b181f1ff70c40c9/users/190e671a77354ac588108d5063fce511/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.548635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b2754d00ae4f899b181f1ff70c40c9, user_id=190e671a77354ac588108d5063fce511, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.552635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016a1f8-1309-45e6-baf9-810b82df6881 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.556978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f5390-96a4-4301-a735-36d446e64a90 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.579444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.580795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1306/2618] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:19 2022] PUT /identity/v3/projects/14b2754d00ae4f899b181f1ff70c40c9/users/190e671a77354ac588108d5063fce511/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:19.582451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.582944 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.583081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.583287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.583572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] PATH_INFO: `/v3/projects/71f7dd917f3a46a18363c174d47e3c45/users/c598d337b5ae4b6687212dc051c7f553/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.583845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.587433 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f7dd917f3a46a18363c174d47e3c45, user_id=c598d337b5ae4b6687212dc051c7f553, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.595317 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b5025-55af-459e-9bcb-ce649ceda238 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.619092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1313/2619] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:19 2022] PUT /identity/v3/projects/71f7dd917f3a46a18363c174d47e3c45/users/c598d337b5ae4b6687212dc051c7f553/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:19.639881 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] MFA Rules not processed for user `190e671a77354ac588108d5063fce511`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:19.641219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.644863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.645454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.645962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.686211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] MFA Rules not processed for user `c598d337b5ae4b6687212dc051c7f553`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:19.687635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.692396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:19.771671 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1307/2620] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:19.782377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.785036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.841394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1314/2621] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:19.841965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.843756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.918788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289be30-3dfb-4bef-a645-7a0a396c8dda None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.923840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.924697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.925151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.925583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:19.938744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:19.940726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:19.953435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1308/2622] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:19.954575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:19.956125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:19.969080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bddfc-7db3-4354-b1f4-afb85698229c service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:19.973115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:19.974407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:19.974407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:19.974407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.000551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.002015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.014450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1309/2623] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:20.023314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7438-3b38-4712-adf5-5a4b1f398508 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.030305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.030758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.033594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.033990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] PATH_INFO: `/v3/projects/85ba7080e13748458d7b21dff2afeeed` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.036029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ba7080e13748458d7b21dff2afeeed)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.038794 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.147312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ba7080e13748458d7b21dff2afeeed', 'request_id': 'req-5cc267b1-b50e-4525-80cf-905b3c5d8645'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.159651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.160479 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ba7080e13748458d7b21dff2afeeed', 'request_id': 'req-5cc267b1-b50e-4525-80cf-905b3c5d8645'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.170178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7013-1bfa-4f68-bb52-c51515581994 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.178032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ba7080e13748458d7b21dff2afeeed', 'request_id': 'req-5cc267b1-b50e-4525-80cf-905b3c5d8645'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.185482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:20.193477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] The token cache is being invalidate because project 85ba7080e13748458d7b21dff2afeeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:20.194135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.195251 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-5cc267b1-b50e-4525-80cf-905b3c5d8645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.215338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1315/2624] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:19 2022] DELETE /identity/v3/projects/85ba7080e13748458d7b21dff2afeeed => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:20.220318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.220676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.221024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.250919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.251641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.252055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.252403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.252525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:20.254135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.254764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.287398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:20.334449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1316/2625] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:20.335506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.336855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.351126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f349f-de95-45bc-aaae-2c4af4d0afdd None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.356583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.357230 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.357595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.357784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] PATH_INFO: `/v3/users/889a9bd770a44d6ba7f9d800b45b79c6` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.358962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889a9bd770a44d6ba7f9d800b45b79c6)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.359323 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.360887 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.363163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e982673-706e-4cf9-a8e4-2691b0a1dfda service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.383719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1310/2626] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:20.385869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.387960 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.388253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.425326 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:20.426739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.435420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889a9bd770a44d6ba7f9d800b45b79c6'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.441630 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1311/2627] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:20.445606 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.449682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889a9bd770a44d6ba7f9d800b45b79c6'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.450585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889a9bd770a44d6ba7f9d800b45b79c6'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.451717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889a9bd770a44d6ba7f9d800b45b79c6'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.457289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18401634-c8a2-4d2a-8c0f-3b02aa8f5500 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.463174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.464612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.465261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.465420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.466388 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:20.466801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.468810 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.477939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-bdda7406-8108-4e1a-a414-eb4aeb4f9c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889a9bd770a44d6ba7f9d800b45b79c6'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:20.487147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1312/2628] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:20.488237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.490211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.503821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda0fa-6777-4f41-86c3-7be29ebaf1fd admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.508981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.509683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.510019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.511048 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.512415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.513754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.517920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1317/2629] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:20 2022] DELETE /identity/v3/users/889a9bd770a44d6ba7f9d800b45b79c6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:20.522693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.523091 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.523614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.559824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:20.561599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.579155 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1313/2630] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:20 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:20.581638 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.726557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1318/2631] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:20.736089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569ba54-33cc-4a23-9998-3d09e18f1a38 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.753445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.755160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:20.770546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.772767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.804865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.811006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.814411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.816447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.876082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:20.880651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1314/2632] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:20 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:20.885901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.903665 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06265d8-eed3-4d0a-9c6b-ac0309e118b2 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.908329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1fd84-bebe-4577-9c07-31fcfc63aa42 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.913948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.915091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.916741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.926713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.926713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.926713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:20.943435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1315/2633] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:20.950949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:20.969268 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12115b35-52a6-41b2-a1b9-894be1db7581 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:20.987683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:20.987683 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:20.988013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:20.988180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:20.991349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:20.997338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.001241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:21.025112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1316/2634] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:21.029915 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:21.031203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:21.032933 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.033259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.033582 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.045678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:21.047503 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674721b3-ae9a-4ca6-af63-d3374cf242d9 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.048679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79966cc5-1910-4da8-88fe-6d466e695dc5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:21.057558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:21.058858 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.059552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.059948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1319/2635] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:21.063316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] PATH_INFO: `/v3/projects/774fa703d0b1423baee4e703bcb248ba/users/389861db7cdb474c8587a8319e0aa6eb/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.085078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774fa703d0b1423baee4e703bcb248ba, user_id=389861db7cdb474c8587a8319e0aa6eb, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:21.088794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.109278 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1317/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:21 2022] PUT /identity/v3/projects/774fa703d0b1423baee4e703bcb248ba/users/389861db7cdb474c8587a8319e0aa6eb/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:21.110921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.111488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.111774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.155291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:21.156676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:21.246938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1320/2637] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:21.257215 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:21.321139 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777790-90be-4876-bd36-2ed5fccdf683 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:21.325368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:21.326245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.326558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.326924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.337020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:21.338502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.348207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1318/2638] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:21.423968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:21.425493 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:21.438450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd180073-fb36-439e-b4eb-8b2782c37dbf None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:21.443138 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:21.443777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.444055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.444326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] PATH_INFO: `/v3/projects/20da78bd5ff14716aa388d89deadffde` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.445491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20da78bd5ff14716aa388d89deadffde)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:21.447638 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.497793 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20da78bd5ff14716aa388d89deadffde', 'request_id': 'req-9f1c4de8-0280-428b-931b-95179c280ab5'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.504393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20da78bd5ff14716aa388d89deadffde', 'request_id': 'req-9f1c4de8-0280-428b-931b-95179c280ab5'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.512324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20da78bd5ff14716aa388d89deadffde', 'request_id': 'req-9f1c4de8-0280-428b-931b-95179c280ab5'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.524727 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] The token cache is being invalidate because project 20da78bd5ff14716aa388d89deadffde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:21.525025 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.525950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.527478 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1321/2639] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:21 2022] DELETE /identity/v3/projects/20da78bd5ff14716aa388d89deadffde => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:21.531506 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:21.542703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a65f8-6bd9-4395-8878-3c279ff41283 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:21.604523 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:21.605329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:21.605616 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:21.605888 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] PATH_INFO: `/v3/users/190e671a77354ac588108d5063fce511` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:21.607074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190e671a77354ac588108d5063fce511)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:21.608988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:21.657577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190e671a77354ac588108d5063fce511'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.665485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190e671a77354ac588108d5063fce511'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.667239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190e671a77354ac588108d5063fce511'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.668085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190e671a77354ac588108d5063fce511'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.676320 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-03fa2f24-1e35-4b87-a730-e27d3b0e71b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190e671a77354ac588108d5063fce511'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:21.694750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:21.714474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1319/2640] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:21 2022] DELETE /identity/v3/users/190e671a77354ac588108d5063fce511 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:22.015175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.017148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:22.034781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c4de8-0280-428b-931b-95179c280ab5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.065506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:22.126749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.127468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.127822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.128169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] PATH_INFO: `/v3/projects/14b2754d00ae4f899b181f1ff70c40c9` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.130928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b2754d00ae4f899b181f1ff70c40c9)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.133152 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.196569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.197174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.197174 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.237088 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b2754d00ae4f899b181f1ff70c40c9', 'request_id': 'req-99df5773-00b0-4d2a-958a-e695bdc8ce57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:22.238103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] MFA Rules not processed for user `389861db7cdb474c8587a8319e0aa6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:22.240947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:22.246496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b2754d00ae4f899b181f1ff70c40c9', 'request_id': 'req-99df5773-00b0-4d2a-958a-e695bdc8ce57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:22.257978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b2754d00ae4f899b181f1ff70c40c9', 'request_id': 'req-99df5773-00b0-4d2a-958a-e695bdc8ce57'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:22.273396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] The token cache is being invalidate because project 14b2754d00ae4f899b181f1ff70c40c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:22.273687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:22.274347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-99df5773-00b0-4d2a-958a-e695bdc8ce57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:22.281035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1322/2641] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:22 2022] DELETE /identity/v3/projects/14b2754d00ae4f899b181f1ff70c40c9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:22.282631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdddcf-41ef-4fd7-8b50-58c9793bf80a None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.282948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdddcf-41ef-4fd7-8b50-58c9793bf80a None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.283221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdddcf-41ef-4fd7-8b50-58c9793bf80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.311086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f2cdddcf-41ef-4fd7-8b50-58c9793bf80a None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:22.312510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f2cdddcf-41ef-4fd7-8b50-58c9793bf80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:22.340437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1320/2642] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:22.345238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.346984 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:22.393329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1323/2643] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:22.404328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.404655 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.404899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.430145 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:22.431302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:22.445212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1324/2644] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:22.448105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.450722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92e92-14a1-41ca-ac0a-68781a849485 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.456400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.457164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.457520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.457645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f2a6-2e16-41b0-afa9-25cb872a7842 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.457934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.458732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.461269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.464404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.466585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.466909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.467172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.468232 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:22.468547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.470166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.483502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1325/2645] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:22.487932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.498850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36cbd4-0e8f-432f-a98b-3275a7984eaf admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.499917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1321/2646] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/projects => generated 405 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:22.503996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.538853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:22.567644 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.568253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.568534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.568818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.569445 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.571389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.574082 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1531-ae4e-4960-a6ec-6957d0c22a54 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.580041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.580928 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.581279 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.582164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.582925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.584919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.605912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:22.609548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1326/2647] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:22.613559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.620257 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1322/2648] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:22.621269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.632947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0105c-2002-4dcc-bb32-968fded9edb9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.682294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbf92a-30b8-44d2-8984-87b91b22d6a5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.687305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.688142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.688599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.688880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.690141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.692487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.698439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.699080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.699364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.700090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.700879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.701882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.712820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1323/2649] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:22.717726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.720455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1327/2650] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:22.725103 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.727959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c36f6-cc78-4e4d-92da-97fd22edfb40 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.734077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.734779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.735079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.735340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] PATH_INFO: `/v3/projects/6e0f3566bb84465289218837a410a2c2/users/2166a655e6ab4761b2518dcb729823fc/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.737673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a74fed-e001-4473-ad97-83c76aa60fc5 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.743847 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.745364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.745656 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.745923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.746690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.748429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.753232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0f3566bb84465289218837a410a2c2, user_id=2166a655e6ab4761b2518dcb729823fc, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.756863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.759490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1328/2651] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:22.763457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.774301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924577ba-05b0-4b9a-8afc-05d46438f3b2 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.779825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1324/2652] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:22 2022] PUT /identity/v3/projects/6e0f3566bb84465289218837a410a2c2/users/2166a655e6ab4761b2518dcb729823fc/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:22.784046 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.844853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.845714 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.846095 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.846475 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.847274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.848953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.856136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36980b-104a-4eb0-a174-8f2c91a25fba admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.861621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.862336 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1329/2653] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:22.862486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.862486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.862919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.863587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.865357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.866264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.877285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd070-1bb9-4b2c-a63e-f63336711d92 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.878081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1325/2654] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:22.882304 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:22.886080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.886861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.887213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.887552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] PATH_INFO: `/v3/projects/5369f519650344c5b552fd09634827fc/users/9b673704aa4e496aa96d09380ce3f3b0/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.893451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad6b2e-45b1-49b6-85b6-184aff17fe08 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:22.898614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:22.899307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.899594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.899882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] PATH_INFO: `/v3/projects/6e0f3566bb84465289218837a410a2c2/users/2166a655e6ab4761b2518dcb729823fc/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.902039 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0f3566bb84465289218837a410a2c2, user_id=2166a655e6ab4761b2518dcb729823fc, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.903849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5369f519650344c5b552fd09634827fc, user_id=9b673704aa4e496aa96d09380ce3f3b0, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:22.904991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b10c-0024-43bf-a58d-05505c5167a1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.906750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:22.917716 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1326/2655] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:22 2022] PUT /identity/v3/projects/6e0f3566bb84465289218837a410a2c2/users/2166a655e6ab4761b2518dcb729823fc/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:22.931807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1330/2656] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:22 2022] PUT /identity/v3/projects/5369f519650344c5b552fd09634827fc/users/9b673704aa4e496aa96d09380ce3f3b0/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:22.934965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea4de-2f4d-481b-bc3b-2631a27b8916 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:22.935440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea4de-2f4d-481b-bc3b-2631a27b8916 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:22.936064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea4de-2f4d-481b-bc3b-2631a27b8916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:22.975747 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-969ea4de-2f4d-481b-bc3b-2631a27b8916 None None] MFA Rules not processed for user `9b673704aa4e496aa96d09380ce3f3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:22.977002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-969ea4de-2f4d-481b-bc3b-2631a27b8916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:23.039633 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:23.071906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1327/2657] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:23.089528 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:23.092705 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:23.116568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:23.223905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef433-e333-4ee0-bab6-aa5864cee8bb admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:23.231055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:23.231807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:23.233293 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:23.233647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:23.246485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:23.248245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:23.273632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1331/2658] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:23.824195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:23.824777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:23.824894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:23.886260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] MFA Rules not processed for user `2166a655e6ab4761b2518dcb729823fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:23.887791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:24.011210 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1328/2659] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:25.205447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:25.208589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:25.233581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:25.339877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226bab-6e6d-43bd-9669-031d64a9ca81 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:25.347923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:25.355433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.355433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.355433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] PATH_INFO: `/v3/users/389861db7cdb474c8587a8319e0aa6eb` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.356280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a557e5-95e2-4017-aafe-108564d8b0c4 service glance] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:25.358367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=389861db7cdb474c8587a8319e0aa6eb)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:25.363835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:25.364412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:25.365424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.365886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.366349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] PATH_INFO: `/v3/users/34e978fc712e4dedbdcf84db3a2658e2` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.368491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e978fc712e4dedbdcf84db3a2658e2)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:25.374056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:25.427946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389861db7cdb474c8587a8319e0aa6eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.436165 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e978fc712e4dedbdcf84db3a2658e2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.437410 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389861db7cdb474c8587a8319e0aa6eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.438432 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389861db7cdb474c8587a8319e0aa6eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.439118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389861db7cdb474c8587a8319e0aa6eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.445052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e978fc712e4dedbdcf84db3a2658e2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.446073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e978fc712e4dedbdcf84db3a2658e2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.447439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e978fc712e4dedbdcf84db3a2658e2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.448911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c5d7d617-4030-4c59-8b56-d45fc9a69b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389861db7cdb474c8587a8319e0aa6eb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.455363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:25.457812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e978fc712e4dedbdcf84db3a2658e2'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.473047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1329/2660] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:25 2022] DELETE /identity/v3/users/389861db7cdb474c8587a8319e0aa6eb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:25.484519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1332/2661] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:25 2022] DELETE /identity/v3/users/34e978fc712e4dedbdcf84db3a2658e2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:25.489478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.489971 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.490375 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.511757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:25.513248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:25.593744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1330/2662] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:25.603436 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:25.605653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:25.652863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:25.675048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78135286-b6ea-4a1a-9379-a5ba08ea4a6c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:25.679445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:25.681471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:25.682254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:25.683105 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.683562 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.683834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.694414 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:25.695940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:25.700591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1b606-d69d-4c01-a554-59c82ebae270 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:25.708166 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:25.708895 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.709261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.709567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] PATH_INFO: `/v3/projects/774fa703d0b1423baee4e703bcb248ba` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.710925 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774fa703d0b1423baee4e703bcb248ba)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:25.711827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1333/2663] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:25.713569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:25.771127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774fa703d0b1423baee4e703bcb248ba', 'request_id': 'req-fb037577-edf7-4e42-91ce-e06716165a35'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.779441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774fa703d0b1423baee4e703bcb248ba', 'request_id': 'req-fb037577-edf7-4e42-91ce-e06716165a35'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.787277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774fa703d0b1423baee4e703bcb248ba', 'request_id': 'req-fb037577-edf7-4e42-91ce-e06716165a35'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.803302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] The token cache is being invalidate because project 774fa703d0b1423baee4e703bcb248ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:25.803581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.804266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.805784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1331/2664] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:25 2022] DELETE /identity/v3/projects/774fa703d0b1423baee4e703bcb248ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:25.810205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:25.819931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214486b-1270-43c4-b05f-10a71a2f603e service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:25.880734 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:25.881636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:25.881922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:25.882313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] PATH_INFO: `/v3/users/2166a655e6ab4761b2518dcb729823fc` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:25.883364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2166a655e6ab4761b2518dcb729823fc)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:25.885838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:25.940382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2166a655e6ab4761b2518dcb729823fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.954234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2166a655e6ab4761b2518dcb729823fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.954946 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2166a655e6ab4761b2518dcb729823fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.955540 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2166a655e6ab4761b2518dcb729823fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.963041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2166a655e6ab4761b2518dcb729823fc'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:25.996583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1334/2665] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:25 2022] DELETE /identity/v3/users/2166a655e6ab4761b2518dcb729823fc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:26.064001 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.069450 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.136792 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb037577-edf7-4e42-91ce-e06716165a35 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.201749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.202413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.202736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.203017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] PATH_INFO: `/v3/projects/e42af6a6a18c41e5934221179ec76afd` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.204169 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42af6a6a18c41e5934221179ec76afd)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.206098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:26.219334 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:26.281168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.283355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.303361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42af6a6a18c41e5934221179ec76afd', 'request_id': 'req-e1e895f7-02d3-4182-ae8e-429816d689f7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.308755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911ce6f-99ef-4dfb-b905-acff3af27aee admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.311452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42af6a6a18c41e5934221179ec76afd', 'request_id': 'req-e1e895f7-02d3-4182-ae8e-429816d689f7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.320835 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42af6a6a18c41e5934221179ec76afd', 'request_id': 'req-e1e895f7-02d3-4182-ae8e-429816d689f7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.336178 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] The token cache is being invalidate because project e42af6a6a18c41e5934221179ec76afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:26.336595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.337613 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.343670 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1332/2666] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:26 2022] DELETE /identity/v3/projects/e42af6a6a18c41e5934221179ec76afd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:26.347822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.349666 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.399240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:26.405196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.406068 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.406531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.406980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] PATH_INFO: `/v3/projects/6e0f3566bb84465289218837a410a2c2` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.408352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0f3566bb84465289218837a410a2c2)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.410942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:26.461874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e895f7-02d3-4182-ae8e-429816d689f7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.468852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.469822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.470261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.470849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] PATH_INFO: `/v3/users/c598d337b5ae4b6687212dc051c7f553` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.472480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c598d337b5ae4b6687212dc051c7f553)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.475554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:26.483495 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0f3566bb84465289218837a410a2c2', 'request_id': 'req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.493634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0f3566bb84465289218837a410a2c2', 'request_id': 'req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.505845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0f3566bb84465289218837a410a2c2', 'request_id': 'req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.521193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] The token cache is being invalidate because project 6e0f3566bb84465289218837a410a2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:26.521630 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.522675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6a70d5e3-97d2-4f85-8081-42a5fb8fcb0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.524733 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1335/2667] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:26 2022] DELETE /identity/v3/projects/6e0f3566bb84465289218837a410a2c2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:26.530015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.530284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.530611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.553837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c598d337b5ae4b6687212dc051c7f553'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.561035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:26.562245 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.565075 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c598d337b5ae4b6687212dc051c7f553'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.565893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c598d337b5ae4b6687212dc051c7f553'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.566781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c598d337b5ae4b6687212dc051c7f553'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.576036 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1cbb624b-2b84-48fc-a85c-4d0d19927179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c598d337b5ae4b6687212dc051c7f553'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:26.604973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1333/2668] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:26 2022] DELETE /identity/v3/users/c598d337b5ae4b6687212dc051c7f553 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:26.662840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1336/2669] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:26.669853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.669853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.669853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.692611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:26.693906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.709367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:26.776032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1334/2670] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:26.778616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.791608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd336f-dfb2-44e4-840b-6688bb5f1672 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.811934 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.813515 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.813827 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.814113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.814804 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:26.815119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.817329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5ae82-3784-466d-8b00-bba7525f9022 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:26.833625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1337/2671] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:26.839769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.853015 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.854130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.854322 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c969-806c-414b-b6c9-d600f7211659 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.854487 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.859143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.859774 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.860060 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.860336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.860998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.863160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:26.883614 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:26.885356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.897807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1335/2672] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:26 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:26.904617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.967550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1338/2673] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:26.971547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:26.972950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:26.988815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1df687-4e49-4fd1-8efb-605fbf196dec admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.994620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:26.995362 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:26.995664 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:26.995900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be09c85-31fc-439e-965b-903f981f9af9 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:26.996028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:26.996652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:26.998540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.000558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.001192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.001477 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.001749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] PATH_INFO: `/v3/projects/71f7dd917f3a46a18363c174d47e3c45` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.002895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f7dd917f3a46a18363c174d47e3c45)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.004911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.021497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1336/2674] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:26 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:27.022382 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.028556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.028771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:27.061328 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f7dd917f3a46a18363c174d47e3c45', 'request_id': 'req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:27.067519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f7dd917f3a46a18363c174d47e3c45', 'request_id': 'req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:27.080447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f7dd917f3a46a18363c174d47e3c45', 'request_id': 'req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:27.092133 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] The token cache is being invalidate because project 71f7dd917f3a46a18363c174d47e3c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:27.092425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:27.093077 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:27.094629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1339/2675] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:26 2022] DELETE /identity/v3/projects/71f7dd917f3a46a18363c174d47e3c45 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:27.095424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.104803 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.109059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f2550-26c8-4740-b4da-4dd2a68438cc admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.143508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:27.187897 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.189251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.189545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.189825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.192912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.193504 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69bfa8-7c53-45b4-8dd8-555f82c650d9 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.202182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.203087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.203378 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.203653 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.204303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.205995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd7a29-4a4d-4edd-a743-c31b7a80fdce admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.217929 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1340/2676] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:27.219421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.219837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.220124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.241389 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:27.242607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.251863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1341/2677] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:27.252673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.267471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8122f-cba8-40ab-962f-2ce7131f274b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.269495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.271632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3df60-a5f0-47ee-8316-83a905669bdb service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.272141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.272744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.273030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.273312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.273952 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.276190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.282171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1337/2678] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:12:27.288241 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.288538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.288817 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.293148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1342/2679] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:27.294283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.304488 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c36e4-829a-4ab3-9174-6dbb72f7e6a6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.313598 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:27.314171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.314824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.314967 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.315115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.315396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] PATH_INFO: `/v3/projects/20ce07bd94504e2a93bc046f958ae1cc/users/d6000ea2a01a408ca4e83b14cfdca87f/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.325045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1338/2680] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:27.329068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.336839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ce07bd94504e2a93bc046f958ae1cc, user_id=d6000ea2a01a408ca4e83b14cfdca87f, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.339745 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7dc5-362a-43ce-9dc1-064417b01d9f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.341181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.349558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.350381 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.350761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.351008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.351637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:27.351940 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.353674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919c9d1-e7de-43ef-9553-6b2a07283ed4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.362375 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1343/2681] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:27 2022] PUT /identity/v3/projects/20ce07bd94504e2a93bc046f958ae1cc/users/d6000ea2a01a408ca4e83b14cfdca87f/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:27.367077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1339/2682] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:12:27.372201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.372655 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.372942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.373260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.412965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] MFA Rules not processed for user `d6000ea2a01a408ca4e83b14cfdca87f`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:27.414535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:27.482904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:27.488252 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fc7c-b309-4d07-a070-6e74f8728820 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.496977 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.498041 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.498469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.499064 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.499909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.502341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.505619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1340/2683] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:27.511938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.525337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668b9b2-b23a-4538-ba37-d3ebc995b980 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.535707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.536585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.537054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.537733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.538358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.540327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.563053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1344/2684] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:27.567316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.591842 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1341/2685] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:27.596510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.636942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:27.657903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff138e-a4a8-4fb8-b140-0b1901ff9500 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.699740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009192-4cee-4bd5-b23a-d7c69635fbb5 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.704988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.705325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.705725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.705913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.706569 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.708599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.738728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1342/2686] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:27.743189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.753589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.754452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.754839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.755198 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.755765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133995-36b6-4014-a3d1-9d574f5fc6f9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.756214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.758530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.764133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.764750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.765058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.765337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.766104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.767909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.785904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1343/2687] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:27.786972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.800959 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1345/2688] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:27 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:27.801189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea49d5-140d-44d2-8ec3-ce15f152f02a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.801795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.804469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.805219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.805580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.805933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] PATH_INFO: `/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d/users/31b940ee51934615b3f3d55e340ed25e/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.813544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f0610-b20a-4a5d-9bae-1fac104a796c admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.818752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.819351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.819637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.819922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.820569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.822939 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.828515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfb9779d1de49e59ca84c0bd4745b1d, user_id=31b940ee51934615b3f3d55e340ed25e, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.831553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.834633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1346/2689] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:27.839405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.845846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1344/2690] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:27 2022] PUT /identity/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d/users/31b940ee51934615b3f3d55e340ed25e/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:27.849339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611d45-aca9-4112-8ccc-d200c4a5dfdf admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.849659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.919099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e32a-6c8c-4d8c-95f0-b16d32f92aba admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.919466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.920101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.920417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.920770 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.921349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.923071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.924292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.924903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.925190 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.925469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.926119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.928739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.939200 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1347/2691] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:12:27.940771 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.946828 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1345/2692] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:27.948260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:27.949773 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:27.953543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251db79a-8cda-4fba-aac1-612e7dbf072d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.961388 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.962066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.962352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.963185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] PATH_INFO: `/v3/projects/d4ea3842e756471292634cf8f7bccb50/users/f25a0cbb9f084886903044ce349a733c/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.965898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dec9e-f655-4f4f-b385-a1ceae1272ba admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:27.972020 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:27.972722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:27.973007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:27.973282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] PATH_INFO: `/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d/users/31b940ee51934615b3f3d55e340ed25e/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:27.975869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfb9779d1de49e59ca84c0bd4745b1d, user_id=31b940ee51934615b3f3d55e340ed25e, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.979529 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc145e5-d045-476a-9a69-f4596f154783 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.985312 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ea3842e756471292634cf8f7bccb50, user_id=f25a0cbb9f084886903044ce349a733c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:27.988256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a0f0f-e129-48a6-a685-29e73491f9f6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:27.994539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1346/2693] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:27 2022] PUT /identity/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d/users/31b940ee51934615b3f3d55e340ed25e/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:28.005537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:28.006209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:28.006421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:28.015987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1348/2694] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:27 2022] PUT /identity/v3/projects/d4ea3842e756471292634cf8f7bccb50/users/f25a0cbb9f084886903044ce349a733c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:28.027080 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:28.027351 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:28.027623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:28.048667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] MFA Rules not processed for user `31b940ee51934615b3f3d55e340ed25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:28.050089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:28.061844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] MFA Rules not processed for user `f25a0cbb9f084886903044ce349a733c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:28.063222 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:28.103120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:28.131473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1347/2695] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:28.136250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1349/2696] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:28.143544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:28.144916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:28.147666 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:28.148978 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:28.209177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e7f89-2f8a-410b-b093-01bb602ad6e7 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:28.213558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:28.214288 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:28.214567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:28.214886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:28.224350 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d3779-623b-4f29-9404-b1c795eef3ce None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:28.224689 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:28.226127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:28.228781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:28.229724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:28.230301 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:28.230695 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:28.236242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1348/2697] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:12:28.246392 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:28.248014 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:28.259391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1350/2698] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:28.325405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:28.326988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:28.340052 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e273c-61c7-4e89-897f-462dc8c80465 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:28.343755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:28.344355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:28.344636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:28.344906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:28.412824 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:28.414274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4594919-c167-4e98-b90c-c65bd31063a7 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:28.424766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1349/2699] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:38.253616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:38.419764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=62 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:48.106694 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:48.169305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee0b03-18e5-49af-aa7a-66b983164997 service glance] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:48.174007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:48.174822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:48.175099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:48.175373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] PATH_INFO: `/v3/users/f25a0cbb9f084886903044ce349a733c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:48.176502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25a0cbb9f084886903044ce349a733c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:48.178417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:48.227622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25a0cbb9f084886903044ce349a733c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.235932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25a0cbb9f084886903044ce349a733c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.236938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25a0cbb9f084886903044ce349a733c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.237087 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25a0cbb9f084886903044ce349a733c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.244549 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25a0cbb9f084886903044ce349a733c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.262463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1351/2700] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:48 2022] DELETE /identity/v3/users/f25a0cbb9f084886903044ce349a733c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:48.267286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:48.267768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:48.268074 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:48.289695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:48.291127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:48.355871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1350/2701] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:48.365928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:48.367673 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:48.428450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5afb-7987-471b-a793-f1e72012f861 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:48.432816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:48.433430 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:48.433716 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:48.433995 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:48.443779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:48.445848 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:48.455701 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1352/2702] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:48.755468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:48.757219 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:48.772684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5235a-c43e-4e6e-be04-a69dc9143ded None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:48.781767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:48.782518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:48.782890 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:48.783172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] PATH_INFO: `/v3/projects/d4ea3842e756471292634cf8f7bccb50` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:48.784444 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ea3842e756471292634cf8f7bccb50)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:48.786445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:48.845248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ea3842e756471292634cf8f7bccb50', 'request_id': 'req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.852557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ea3842e756471292634cf8f7bccb50', 'request_id': 'req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.860353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ea3842e756471292634cf8f7bccb50', 'request_id': 'req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.873371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] The token cache is being invalidate because project d4ea3842e756471292634cf8f7bccb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:48.873740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.874554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-19d7a0ef-31a1-4f88-99fe-3bfc84f672b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:48.876261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1351/2703] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:48 2022] DELETE /identity/v3/projects/d4ea3842e756471292634cf8f7bccb50 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:50.755826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:50.757221 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:50.770130 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030043e-994a-4eb4-86fc-bceeca0b61d6 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:50.788583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:50.833640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:50.834283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:50.834564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:50.834868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] PATH_INFO: `/v3/users/9b673704aa4e496aa96d09380ce3f3b0` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:50.836287 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b673704aa4e496aa96d09380ce3f3b0)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:50.838196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:50.890760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b673704aa4e496aa96d09380ce3f3b0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:50.898863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b673704aa4e496aa96d09380ce3f3b0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:50.899580 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b673704aa4e496aa96d09380ce3f3b0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:50.900338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b673704aa4e496aa96d09380ce3f3b0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:50.907836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b673704aa4e496aa96d09380ce3f3b0'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:50.926937 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1353/2704] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:50 2022] DELETE /identity/v3/users/9b673704aa4e496aa96d09380ce3f3b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:50.931487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:50.931936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:50.932242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:50.951645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:50.952963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:51.020271 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1352/2705] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:51.031042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:51.033079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:51.098568 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4fdec-3015-4a60-9a7e-bc1cb301bbd1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:51.103126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:51.103909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:51.104193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:51.104471 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:51.113904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:51.115437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:51.125048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1354/2706] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:51.386480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:51.387958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:51.405815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf890-4b58-467b-b881-3dc4a7fefeee None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:51.410764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:51.411471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:51.411643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:51.411921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] PATH_INFO: `/v3/projects/5369f519650344c5b552fd09634827fc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:51.413119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5369f519650344c5b552fd09634827fc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:51.414998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:51.436242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:51.463843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5369f519650344c5b552fd09634827fc', 'request_id': 'req-a8574358-529e-4b94-9561-7704c8800740'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:51.469884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5369f519650344c5b552fd09634827fc', 'request_id': 'req-a8574358-529e-4b94-9561-7704c8800740'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:51.477249 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5369f519650344c5b552fd09634827fc', 'request_id': 'req-a8574358-529e-4b94-9561-7704c8800740'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:51.487426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] The token cache is being invalidate because project 5369f519650344c5b552fd09634827fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:51.487714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:51.488329 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a8574358-529e-4b94-9561-7704c8800740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:51.489790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1353/2707] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:51 2022] DELETE /identity/v3/projects/5369f519650344c5b552fd09634827fc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:57.803438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:57.805400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:57.817884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7be57c-15e0-4341-8779-a854070aa8c2 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:57.859135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:57.875059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:57.875682 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:57.875965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:57.876240 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] PATH_INFO: `/v3/users/d6000ea2a01a408ca4e83b14cfdca87f` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:57.877446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6000ea2a01a408ca4e83b14cfdca87f)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:57.879707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:57.924082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6000ea2a01a408ca4e83b14cfdca87f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:57.931840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6000ea2a01a408ca4e83b14cfdca87f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:57.932607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6000ea2a01a408ca4e83b14cfdca87f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:57.933208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6000ea2a01a408ca4e83b14cfdca87f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:57.940506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6000ea2a01a408ca4e83b14cfdca87f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:57.957818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1355/2708] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:57 2022] DELETE /identity/v3/users/d6000ea2a01a408ca4e83b14cfdca87f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:12:57.962469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:57.962999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:57.963106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:57.994275 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:57.995610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:58.055099 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1354/2709] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:58.064752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:58.066155 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:58.124062 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424bef9-6aca-4fb9-a812-b6241bc78c2b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:58.127742 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:58.128420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:58.128704 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:58.128979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:58.138096 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:58.139563 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:58.148909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1356/2710] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:12:58.413624 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:58.415371 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:58.427485 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2df0b-15cd-4e89-ae07-85decfefa879 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:58.432882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:58.433977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:58.433977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:58.434216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] PATH_INFO: `/v3/projects/20ce07bd94504e2a93bc046f958ae1cc` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:58.435207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ce07bd94504e2a93bc046f958ae1cc)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:58.437112 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:58.484767 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ce07bd94504e2a93bc046f958ae1cc', 'request_id': 'req-ed5a88b7-3782-44e1-a9f9-e646d9249255'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.491734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ce07bd94504e2a93bc046f958ae1cc', 'request_id': 'req-ed5a88b7-3782-44e1-a9f9-e646d9249255'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.499229 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ce07bd94504e2a93bc046f958ae1cc', 'request_id': 'req-ed5a88b7-3782-44e1-a9f9-e646d9249255'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.510480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] The token cache is being invalidate because project 20ce07bd94504e2a93bc046f958ae1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:58.510821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.511474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.512965 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1355/2711] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:58 2022] DELETE /identity/v3/projects/20ce07bd94504e2a93bc046f958ae1cc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:58.516922 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:58.526698 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa055d-977c-4e28-b805-8e6a36ea33cc service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:58.585134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:58.585851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:58.586134 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:58.586410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] PATH_INFO: `/v3/users/31b940ee51934615b3f3d55e340ed25e` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:58.587554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b940ee51934615b3f3d55e340ed25e)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:58.589480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:58.594662 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:58.635314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b940ee51934615b3f3d55e340ed25e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.642285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b940ee51934615b3f3d55e340ed25e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.642924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b940ee51934615b3f3d55e340ed25e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.643524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b940ee51934615b3f3d55e340ed25e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.650545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64bae9ed-9d92-4f7b-9844-9a6b09430989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b940ee51934615b3f3d55e340ed25e'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:58.667824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1357/2712] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:12:58 2022] DELETE /identity/v3/users/31b940ee51934615b3f3d55e340ed25e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:58.932986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:58.935003 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:58.950204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a88b7-3782-44e1-a9f9-e646d9249255 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:58.980353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:59.011216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.011857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.012195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.012430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] PATH_INFO: `/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.013552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfb9779d1de49e59ca84c0bd4745b1d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.015501 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.062573 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfb9779d1de49e59ca84c0bd4745b1d', 'request_id': 'req-bba4fe71-8259-4814-b3d6-a09fd61e38d5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:59.068934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfb9779d1de49e59ca84c0bd4745b1d', 'request_id': 'req-bba4fe71-8259-4814-b3d6-a09fd61e38d5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:59.076404 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfb9779d1de49e59ca84c0bd4745b1d', 'request_id': 'req-bba4fe71-8259-4814-b3d6-a09fd61e38d5'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:59.087203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] The token cache is being invalidate because project 1bfb9779d1de49e59ca84c0bd4745b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:12:59.087497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:59.088125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bba4fe71-8259-4814-b3d6-a09fd61e38d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:12:59.089608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1356/2713] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:12:58 2022] DELETE /identity/v3/projects/1bfb9779d1de49e59ca84c0bd4745b1d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:59.094621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.095142 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.095256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.115265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:59.117026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:59.179418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1358/2714] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:59.187426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.187718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.187994 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.207538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:59.208740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:59.217470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1357/2715] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:12:59.221658 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.232306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27d564-de74-4f4e-b265-182dbf64d15e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.236810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.237402 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.237686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.237956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.238591 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:12:59.238924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.240506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.251988 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1359/2716] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:12:59.256556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.265766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567dd98b-9d8a-43fe-8fd5-43b8313f2a44 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.270389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.271045 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.271325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.271597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.272768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.274785 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.302441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1358/2717] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:59.306557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.316509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44d9f9-8cbb-450f-88d6-2dd47aa25c22 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.372172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.372755 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.373035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.373305 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.373936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.375894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.397980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1360/2718] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:59.402273 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.412442 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedabdf-0423-43af-a47b-29eca2c5336b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.417644 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.418239 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.418518 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.418830 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.419471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.421062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.431114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1359/2719] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:59.435207 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.440283 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:59.447004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497629e0-a5d7-4e9c-8efe-2ff01a065dc7 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.452397 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.453022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.453307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.453586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.454233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.455846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a63072-502a-42e1-8bb2-44e3a0fc522c admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.467019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1361/2720] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:59.471260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.481848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461fd09-ad0f-4bcc-85af-4524d18ce480 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.486397 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.487064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.487346 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.487617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] PATH_INFO: `/v3/projects/ac4b919a10be4b658752cc074e633d56/users/02eee2d01d9a4dbb91f57628065cc13c/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.502214 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4b919a10be4b658752cc074e633d56, user_id=02eee2d01d9a4dbb91f57628065cc13c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.505115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.517499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1360/2721] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:59 2022] PUT /identity/v3/projects/ac4b919a10be4b658752cc074e633d56/users/02eee2d01d9a4dbb91f57628065cc13c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:59.529303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.529595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.529876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.558819 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] MFA Rules not processed for user `02eee2d01d9a4dbb91f57628065cc13c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:12:59.560008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:12:59.623054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1362/2722] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:12:59.627503 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.686663 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:59.690412 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fae2f2-2a8f-480c-8263-2502d54ad98f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.696856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.697642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.698132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.698462 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.699245 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.701126 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.728761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1361/2723] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:12:59.732873 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.744118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1d9e-05a2-4fda-8b14-96f1706dd10f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.804835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.805393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.805671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.805945 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.806576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.808509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.830766 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1363/2724] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:12:59 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:12:59.834805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.845125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e787-3640-48f9-a948-66ae3a32e096 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.849797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.850914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.851199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.851579 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.852252 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.853841 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.864302 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1362/2725] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:12:59.869074 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.879020 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9abb5-01d0-44a0-b3f0-5bb4b846e77b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.883948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.884628 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.884908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.885181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] PATH_INFO: `/v3/projects/c7228039ee474a0fa452c72484499eca/users/addf0e0c5beb466aae87215ea03b794c/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.900449 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7228039ee474a0fa452c72484499eca, user_id=addf0e0c5beb466aae87215ea03b794c, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.903437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:12:59.916521 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1364/2726] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:12:59 2022] PUT /identity/v3/projects/c7228039ee474a0fa452c72484499eca/users/addf0e0c5beb466aae87215ea03b794c/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:12:59.920433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:12:59.930682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0e0a-893a-4346-97bd-077bac1d5c95 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:12:59.988694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:12:59.989315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:12:59.989599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:12:59.989872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:12:59.990519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:12:59.992476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e2488-c9a5-4bad-a8e9-f52fc0504d08 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:00.002732 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1363/2727] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:00.007424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:00.017489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2099667-a28d-49ac-8974-c87070980172 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:00.022129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:00.023352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:00.023632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:00.023930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] PATH_INFO: `/v3/projects/c7228039ee474a0fa452c72484499eca/users/addf0e0c5beb466aae87215ea03b794c/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:00.025812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7228039ee474a0fa452c72484499eca, user_id=addf0e0c5beb466aae87215ea03b794c, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:00.028473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:00.038846 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1365/2728] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:00 2022] PUT /identity/v3/projects/c7228039ee474a0fa452c72484499eca/users/addf0e0c5beb466aae87215ea03b794c/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:00.048919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:00.049209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:00.049490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:00.078361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] MFA Rules not processed for user `addf0e0c5beb466aae87215ea03b794c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:00.079557 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:00.148632 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1364/2729] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:00.159299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:00.161012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:00.198773 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:00.223744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f83f7-97c3-4692-a088-1f036701e957 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:00.227438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:00.228043 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:00.228323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:00.228599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:00.237486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:00.238932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:00.248710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1366/2730] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:00.296118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:00.297583 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:00.310083 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5d850-6620-4aad-b039-0f3d96e8fbf1 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:00.313684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:00.314281 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:00.314561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:00.314865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:00.361631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:00.371676 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:00.373328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d2447-3f22-4cc0-a87e-83ae69dbb695 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:00.383008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1365/2731] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:03.648548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:03.708986 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc8f6-4fe9-4ce5-912e-fb87c974a58e service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:03.713718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:03.714338 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:03.714624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:03.714932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] PATH_INFO: `/v3/users/02eee2d01d9a4dbb91f57628065cc13c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:03.716035 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02eee2d01d9a4dbb91f57628065cc13c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:03.717924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:03.762616 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02eee2d01d9a4dbb91f57628065cc13c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:03.769743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02eee2d01d9a4dbb91f57628065cc13c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:03.770382 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02eee2d01d9a4dbb91f57628065cc13c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:03.771052 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02eee2d01d9a4dbb91f57628065cc13c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:03.778163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02eee2d01d9a4dbb91f57628065cc13c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:03.795131 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1367/2732] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:03 2022] DELETE /identity/v3/users/02eee2d01d9a4dbb91f57628065cc13c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:03.799599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:03.800103 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:03.800209 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:03.820889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:03.822105 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:03.878861 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1366/2733] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:03.889285 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:03.890724 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:03.948576 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e408b-ec65-4938-b521-8b441a770970 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:03.952296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:03.952900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:03.953182 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:03.953457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:03.962426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:03.963875 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:03.967708 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:03.980224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1368/2734] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:04.248788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:04.250242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:04.263093 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906d83-6108-425a-bd9c-436d4efe4844 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:04.267821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:04.268395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:04.268677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:04.268947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] PATH_INFO: `/v3/projects/ac4b919a10be4b658752cc074e633d56` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:04.270095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4b919a10be4b658752cc074e633d56)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:04.272151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:04.320127 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4b919a10be4b658752cc074e633d56', 'request_id': 'req-2a05a99f-ba9e-4265-b549-f91cff167556'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.326197 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4b919a10be4b658752cc074e633d56', 'request_id': 'req-2a05a99f-ba9e-4265-b549-f91cff167556'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.332921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4b919a10be4b658752cc074e633d56', 'request_id': 'req-2a05a99f-ba9e-4265-b549-f91cff167556'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.343510 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] The token cache is being invalidate because project ac4b919a10be4b658752cc074e633d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:04.343802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.344456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.345931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1367/2735] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:04 2022] DELETE /identity/v3/projects/ac4b919a10be4b658752cc074e633d56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:04.349880 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:04.360054 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ba5a9-5016-41cc-b7c7-21e0257543ed service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:04.416720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:04.417349 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:04.417632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:04.417908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] PATH_INFO: `/v3/users/addf0e0c5beb466aae87215ea03b794c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:04.419050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] RBAC: Authorizing `identity:delete_user(user_id=addf0e0c5beb466aae87215ea03b794c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:04.420965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:04.467838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addf0e0c5beb466aae87215ea03b794c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.475194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addf0e0c5beb466aae87215ea03b794c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.476104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addf0e0c5beb466aae87215ea03b794c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.476719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addf0e0c5beb466aae87215ea03b794c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.483606 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d290f457-08c8-45c0-98cd-748f76e5917b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addf0e0c5beb466aae87215ea03b794c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.501162 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1369/2736] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:04 2022] DELETE /identity/v3/users/addf0e0c5beb466aae87215ea03b794c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:04.771122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:04.772797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:04.786232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a99f-ba9e-4265-b549-f91cff167556 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:04.846843 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:04.847479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:04.847750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:04.848026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] PATH_INFO: `/v3/projects/c7228039ee474a0fa452c72484499eca` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:04.849135 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7228039ee474a0fa452c72484499eca)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:04.851566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:04.868690 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:04.900814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7228039ee474a0fa452c72484499eca', 'request_id': 'req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.906877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7228039ee474a0fa452c72484499eca', 'request_id': 'req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.914777 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7228039ee474a0fa452c72484499eca', 'request_id': 'req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.925143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] The token cache is being invalidate because project c7228039ee474a0fa452c72484499eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:04.925434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.926054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-a79d7ec2-fc5f-4e14-bc9b-d7819bd36b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:04.927575 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1368/2737] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:04 2022] DELETE /identity/v3/projects/c7228039ee474a0fa452c72484499eca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:04.933024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:04.933513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:04.933611 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:04.953070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:04.954313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:05.013909 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1370/2738] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:05.021798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.022055 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.022309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.042353 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:05.043608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:05.051750 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1369/2739] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:05.056717 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.066280 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e9f9-53dd-4aea-8720-779bbba43306 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.071038 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.071683 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.071963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.072239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.072903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:05.073205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.074844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.086920 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1371/2740] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:05.091176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.101067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b56d-1574-418b-81fd-8d69df579558 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.105717 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.106309 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.106593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.106905 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.107556 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.109445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.137072 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1370/2741] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:05 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:05.141342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.148127 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:05.152158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab401000-2cee-46bc-890e-7b95d50e20dd admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.210026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.210813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.211097 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.211368 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.211987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.214019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.234910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1372/2742] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:05 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:05.238975 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.249118 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e29949-6d1c-4759-ba84-5e308efddcf9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.253635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.254597 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.254909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.255183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.255852 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.257457 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.267222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1371/2743] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:05.271036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.281523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82d0b-8e5b-4b09-a225-aa7c30e191a8 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.286021 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.286615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.286926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.287203 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.288535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.290143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea306c-d111-4916-8e73-92f49cfc8336 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.300543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1373/2744] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:05.304517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.314414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f785f-4ce4-4816-ad97-97827c5d4512 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.319050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.319696 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.319978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.320251 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] PATH_INFO: `/v3/projects/e3b376f620d74959a044a330d7452178/users/40e3e895f11e480b80c8b690b096b57c/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.335544 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b376f620d74959a044a330d7452178, user_id=40e3e895f11e480b80c8b690b096b57c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.338149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.351316 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1372/2745] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:05 2022] PUT /identity/v3/projects/e3b376f620d74959a044a330d7452178/users/40e3e895f11e480b80c8b690b096b57c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:05.362506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.362825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.363102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.390815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] MFA Rules not processed for user `40e3e895f11e480b80c8b690b096b57c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:05.392051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:05.455524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1374/2746] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:05.466952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:05.468667 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:05.525647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8244a-d939-4605-8de7-cf74a8c4d5ce admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:05.529567 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:05.530171 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:05.530453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:05.530761 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:05.539581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:05.540943 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713af31b-3ca4-42a4-bc84-72d75ee55d49 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:05.549691 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1373/2747] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:08.591992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:08.664620 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29eb8b-e6dd-445f-8bff-c10aa702a547 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:08.669399 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:08.677807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:08.678141 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:08.679530 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] PATH_INFO: `/v3/users/40e3e895f11e480b80c8b690b096b57c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:08.680744 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e3e895f11e480b80c8b690b096b57c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:08.682631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:08.696384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:08.731022 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e3e895f11e480b80c8b690b096b57c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:08.739426 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e3e895f11e480b80c8b690b096b57c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:08.740036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e3e895f11e480b80c8b690b096b57c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:08.741049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e3e895f11e480b80c8b690b096b57c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:08.748319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e3e895f11e480b80c8b690b096b57c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:08.766507 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1375/2748] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:08 2022] DELETE /identity/v3/users/40e3e895f11e480b80c8b690b096b57c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:08.770978 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:08.771453 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:08.771574 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:08.791189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:08.792430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:08.834728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:08.860016 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1374/2749] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:08.870174 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:08.871648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:08.932876 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09b4e9-338d-4189-bcd1-4db3c6222270 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:08.936558 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:08.937192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:08.937466 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:08.937735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:08.947438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:08.948869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686214a1-3a21-45b8-868e-316d0f768240 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:08.958462 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1376/2750] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:09.340365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.342884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:09.355868 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a062917-f061-45d8-9db4-9d552886a63e None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.360539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.361170 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.361448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.361718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] PATH_INFO: `/v3/projects/e3b376f620d74959a044a330d7452178` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.362860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b376f620d74959a044a330d7452178)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.364743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.438736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b376f620d74959a044a330d7452178', 'request_id': 'req-1800cf1d-7166-4eee-8591-137138573761'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:09.445187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b376f620d74959a044a330d7452178', 'request_id': 'req-1800cf1d-7166-4eee-8591-137138573761'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:09.453165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b376f620d74959a044a330d7452178', 'request_id': 'req-1800cf1d-7166-4eee-8591-137138573761'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:09.464452 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] The token cache is being invalidate because project e3b376f620d74959a044a330d7452178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:09.464746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:09.465395 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-1800cf1d-7166-4eee-8591-137138573761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:09.467672 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1375/2751] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:09 2022] DELETE /identity/v3/projects/e3b376f620d74959a044a330d7452178 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:09.473441 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.473751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.474027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.494603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:09.495835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:09.570448 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1377/2752] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:09.578267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.578798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.579205 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.599582 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:09.601459 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:09.610058 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1376/2753] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:09.614270 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.625304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba30ad0-874b-454d-9b67-a706ab4f7c4c None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.630752 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.631376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.631663 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.632112 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.633108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:09.633429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.635213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.651238 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1378/2754] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:09.655673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.666537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e625-9351-4121-bf9f-d0ffa2289789 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.673299 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.673997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.674509 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.674880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.675584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.677627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.720111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1377/2755] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:09.724394 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.737386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d099b25-033b-484d-81b7-d086b7c31e34 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.766518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:09.819071 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.821160 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.821670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.822124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.822982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.825236 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.854720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1379/2756] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:09 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:09.858916 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.873749 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70397e-0267-4536-b09a-c8581f23825a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.892185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.893228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.893538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.893809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.894919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.896929 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.909054 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1378/2757] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:13:09.914314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.929997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57d4c-5c77-4472-9e3e-c96fca4d4f98 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.935745 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.936446 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.936863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.937212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.938121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:09.939919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f799-0e6c-4055-b1c0-0e62115e33d0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:09.954693 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1380/2758] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:09.957022 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:09.970768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039bb44-dd06-487f-b8e1-66cf5759e58e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:09.975642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:09.977419 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:09.977711 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:09.977990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] PATH_INFO: `/v3/projects/c3af5ba9b9ea4a0a8731d963e8ae9ca2/users/d948a347d0e84442913b380efc09b5c0/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:09.999739 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3af5ba9b9ea4a0a8731d963e8ae9ca2, user_id=d948a347d0e84442913b380efc09b5c0, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:10.002426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:10.016936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1379/2759] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:09 2022] PUT /identity/v3/projects/c3af5ba9b9ea4a0a8731d963e8ae9ca2/users/d948a347d0e84442913b380efc09b5c0/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:10.027911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89de62-de4e-4ddb-b0a8-0d5a78f7b6fc None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:10.028196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89de62-de4e-4ddb-b0a8-0d5a78f7b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:10.028468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89de62-de4e-4ddb-b0a8-0d5a78f7b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:10.057762 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-2b89de62-de4e-4ddb-b0a8-0d5a78f7b6fc None None] MFA Rules not processed for user `d948a347d0e84442913b380efc09b5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:10.059010 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2b89de62-de4e-4ddb-b0a8-0d5a78f7b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:10.124868 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1381/2760] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:10.137089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:10.138934 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:10.198797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d718cf-b0d5-4aa6-991f-a1d333b80636 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:10.202467 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:10.203115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:10.203400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:10.203680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:10.214078 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:10.215542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:10.224566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1380/2761] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:11.653220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:11.653729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:11.654215 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:11.673884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] MFA Rules not processed for user `d948a347d0e84442913b380efc09b5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:11.675109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:11.688511 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1382/2762] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:14.014203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:14.016434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:14.030725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:14.089133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755b4a5-2fd4-443f-b9d7-22da236be683 service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:14.093891 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:14.094948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:14.095305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:14.095720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:14.097553 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:14.176376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:14.177882 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:14.189465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1381/2763] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:17.160841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:17.163536 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:17.233859 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:17.236379 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:17.256030 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7d220-9b4e-460d-b45f-0c2b6913ab92 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:17.272380 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:17.273122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.273695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.275460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] PATH_INFO: `/v3/users/071e49ba214a4ff1be50157f514fc2db` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.276808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071e49ba214a4ff1be50157f514fc2db)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:17.279601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:17.281136 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f866002-788b-4248-aff1-7f41ba11780f None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:17.292480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:17.293217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.293509 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.293786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.298357 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:17.327786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:17.329463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:17.359373 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1383/2764] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:17.374428 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071e49ba214a4ff1be50157f514fc2db'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.385486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071e49ba214a4ff1be50157f514fc2db'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.386608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071e49ba214a4ff1be50157f514fc2db'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.387537 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071e49ba214a4ff1be50157f514fc2db'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.400125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-7a80beb5-8379-4bf4-8322-f3c9b5a171a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071e49ba214a4ff1be50157f514fc2db'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.432704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1382/2765] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:17 2022] DELETE /identity/v3/users/071e49ba214a4ff1be50157f514fc2db => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:17.637853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:17.649740 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51b94-ce38-496d-9eb9-b92baf3b5207 service placement] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:17.659281 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:17.709718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:17.710364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.710648 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.710956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] PATH_INFO: `/v3/projects/33235763fc8e4ec298109d5b58c34d7c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.712178 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33235763fc8e4ec298109d5b58c34d7c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:17.714123 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:17.763613 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33235763fc8e4ec298109d5b58c34d7c', 'request_id': 'req-84445e3c-4d1b-4475-a652-6d0d193b7522'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.769603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33235763fc8e4ec298109d5b58c34d7c', 'request_id': 'req-84445e3c-4d1b-4475-a652-6d0d193b7522'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.777009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33235763fc8e4ec298109d5b58c34d7c', 'request_id': 'req-84445e3c-4d1b-4475-a652-6d0d193b7522'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.788009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] The token cache is being invalidate because project 33235763fc8e4ec298109d5b58c34d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:17.788259 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.788898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-84445e3c-4d1b-4475-a652-6d0d193b7522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:17.790401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1384/2766] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:17 2022] DELETE /identity/v3/projects/33235763fc8e4ec298109d5b58c34d7c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:17.795411 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.795701 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.795976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.818176 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:17.819700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:17.844132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:17.885204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1383/2767] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:17.893321 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.893633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.893910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.915674 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:17.916881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:17.924938 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1385/2768] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:17.929480 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:17.939140 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8423651-c2fc-4fed-a4a5-f4b2e6c30180 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:17.943976 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:17.944618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.944901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.945260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.945920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:17.946228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:17.947889 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:17.960025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1384/2769] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:17.964355 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:17.973636 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00fb54-e119-41e3-bdaf-0442b2049de1 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:17.979159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:17.979764 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:17.980048 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:17.980322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:17.980962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:17.982903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.011166 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1386/2770] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:17 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:18.015437 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.025963 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acd14a-221d-420d-a480-29d46cf35a7b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.080939 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.081546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.081832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.082111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.084612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.085263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.108681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1385/2771] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:18 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:18.112855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.123623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bd5dd-df4e-4139-8cfb-eb0768ae4d4a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.128560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.129170 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.129453 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.129728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.130371 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.132250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.142615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1387/2772] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:18.147339 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.157545 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b584-ac38-4fd4-8754-e21c32bc2463 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.162400 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.163652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.163997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.164340 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.165059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.166763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c62edb-3aa2-4f35-a919-eaecad603bb0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.177760 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1386/2773] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:18.182158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.192377 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2470d5-3eb2-4e74-a1b2-9e21d7ec5a46 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.197603 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.198264 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.198547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.198850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] PATH_INFO: `/v3/projects/6cec6aea75ed412eb222cd5d810b86a3/users/9fd20e0acdd54d7493e5e657cf1c8d7e/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.214499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cec6aea75ed412eb222cd5d810b86a3, user_id=9fd20e0acdd54d7493e5e657cf1c8d7e, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.216728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.231051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1388/2774] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:18 2022] PUT /identity/v3/projects/6cec6aea75ed412eb222cd5d810b86a3/users/9fd20e0acdd54d7493e5e657cf1c8d7e/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:18.241640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.242164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.242164 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.272493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] MFA Rules not processed for user `9fd20e0acdd54d7493e5e657cf1c8d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:18.273361 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:18.338413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1387/2775] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:18.342930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.385327 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:18.405936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffd75-2d7e-4b8c-bd30-42bb420a0f6e admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.410696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.411313 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.411593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.411867 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.412625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.414514 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.440158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1389/2776] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:18 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:18.444863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.455599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a97ba0-7226-4298-9dee-c6ce9170d461 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.475926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:18.512577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.513177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.513451 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.513725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.514355 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.516367 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.541090 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1388/2777] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:18 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:13:18.542175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.552491 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313631a9-6538-4868-8039-b2e925ef0c5d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.557795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.558393 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.558696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.558974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.559607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.561183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.571667 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1390/2778] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:18.575820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.586087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68a70-7fc8-421d-b5e5-0c677b1bc717 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.590682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.591327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.591610 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.591884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] PATH_INFO: `/v3/projects/373314c69a4e40c8ac95d5806d152396/users/a72b90646ac24402b3a1f1983645fa4f/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.607498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=373314c69a4e40c8ac95d5806d152396, user_id=a72b90646ac24402b3a1f1983645fa4f, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.610172 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.624061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1389/2779] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:18 2022] PUT /identity/v3/projects/373314c69a4e40c8ac95d5806d152396/users/a72b90646ac24402b3a1f1983645fa4f/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:18.628454 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.638390 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09501-77b8-4487-be3c-4f4a10533750 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.694029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.694639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.695042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.695374 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.696086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.697712 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939255ce-c582-48fa-9e8c-08b74f7e8bf0 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.707319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1391/2780] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:18.712104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.722327 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afe85-0940-4804-9f82-b687705c4fdb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.727801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.728446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.728723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.729102 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] PATH_INFO: `/v3/projects/373314c69a4e40c8ac95d5806d152396/users/a72b90646ac24402b3a1f1983645fa4f/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.731037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373314c69a4e40c8ac95d5806d152396, user_id=a72b90646ac24402b3a1f1983645fa4f, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.733639 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.744138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1390/2781] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:18 2022] PUT /identity/v3/projects/373314c69a4e40c8ac95d5806d152396/users/a72b90646ac24402b3a1f1983645fa4f/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:18.756050 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.756555 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.756919 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.785337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] MFA Rules not processed for user `a72b90646ac24402b3a1f1983645fa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:18.786548 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:18.855359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1392/2782] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:18.866232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:18.868100 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:18.926611 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca04f6d-3fdd-4391-a1eb-a1a527fa3bd1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:18.930212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:18.930850 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:18.931132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:18.931407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:18.987894 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:18.989342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f4c7d-468b-4c1f-b7fe-40587d232bac service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:18.998594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1391/2783] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:21.629849 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:21.640329 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89164a6-1943-475f-b603-ab97578f1663 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:21.643840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:21.644437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:21.644718 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:21.645007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:21.653965 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:21.655409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:21.664809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1393/2784] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:25.770017 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d234-e7a0-4a24-82d4-15fe61b8d071 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:25.770542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d234-e7a0-4a24-82d4-15fe61b8d071 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:25.770646 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14d234-e7a0-4a24-82d4-15fe61b8d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:25.791068 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-ac14d234-e7a0-4a24-82d4-15fe61b8d071 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:25.792290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-ac14d234-e7a0-4a24-82d4-15fe61b8d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:25.819990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:25.853019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1392/2785] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:13:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:25.875425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:25.876833 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:25.903217 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:25.947223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50b0a-abd7-4a44-a9eb-fc7166b50662 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:25.952302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:25.952905 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:25.953185 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:25.953457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:25.961809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:25.963413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:25.971496 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1394/2786] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:26.470225 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716841-fbb2-4d07-bbbe-50eab751a3bd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:26.470516 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716841-fbb2-4d07-bbbe-50eab751a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:26.470847 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716841-fbb2-4d07-bbbe-50eab751a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:26.490479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f8716841-fbb2-4d07-bbbe-50eab751a3bd None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:26.491790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f8716841-fbb2-4d07-bbbe-50eab751a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:26.498893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1393/2787] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:13:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:26.511884 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:26.522318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364fd96-6c36-4af1-9e83-16666dbfc2e1 service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:26.527523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:26.528124 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:26.528434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:26.528709 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:26.537254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:26.538859 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:26.546720 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1395/2788] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:26.778863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f277fe-4aa1-423c-b274-54a0d2b25b04 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:26.779354 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f277fe-4aa1-423c-b274-54a0d2b25b04 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:26.779461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f277fe-4aa1-423c-b274-54a0d2b25b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:26.798798 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-f5f277fe-4aa1-423c-b274-54a0d2b25b04 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:26.799999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f5f277fe-4aa1-423c-b274-54a0d2b25b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:26.807986 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1394/2789] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:13:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:26.823172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:26.835316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4a7a-fe52-45c7-b9e9-839d20e985ba service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:26.841163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:26.841775 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:26.842057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:26.842347 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:26.852632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:26.854233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:26.866781 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1396/2790] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:27.248601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:27.248893 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:27.249191 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:27.269165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:27.270292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:27.278679 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1395/2791] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:13:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:27.291660 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:27.302758 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3a095-0829-45ae-b8fd-201410da06c3 service swift] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:27.307825 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:27.308425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:27.308706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:27.308980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:27.317082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:27.318743 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f02b21-1c13-4d1d-aee5-26c23d511b85 service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:27.326639 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1397/2792] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:29.431877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:29.433297 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:29.498853 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435cfcb-c9af-43af-be42-856c1e632dce None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:29.503631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:29.504260 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:29.504540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:29.504812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] PATH_INFO: `/v3/users/d948a347d0e84442913b380efc09b5c0` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:29.506531 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d948a347d0e84442913b380efc09b5c0)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:29.508474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:29.554981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd948a347d0e84442913b380efc09b5c0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:29.561992 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd948a347d0e84442913b380efc09b5c0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:29.562695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd948a347d0e84442913b380efc09b5c0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:29.563337 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd948a347d0e84442913b380efc09b5c0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:29.571439 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd948a347d0e84442913b380efc09b5c0'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:29.592015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1396/2793] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:29 2022] DELETE /identity/v3/users/d948a347d0e84442913b380efc09b5c0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:29.596609 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:29.597100 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:29.597212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:29.616908 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:29.618098 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:29.675966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1398/2794] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:29.686213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:29.687653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:29.728778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:29.747851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b18d9-e813-4494-a62f-79b933f3ddae admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:29.751561 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:29.752165 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:29.752448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:29.753000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:29.762203 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:29.763653 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644ad33-5eb5-45d0-8aa7-7591f365a3c0 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:29.773149 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1397/2795] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:29.943610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:29.945040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:29.956802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1801f-ec0a-41da-9fae-7b497b08f661 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:29.962201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:29.962866 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:29.963147 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:29.963423 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] PATH_INFO: `/v3/projects/c3af5ba9b9ea4a0a8731d963e8ae9ca2` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:29.964525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3af5ba9b9ea4a0a8731d963e8ae9ca2)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:29.966419 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.015502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3af5ba9b9ea4a0a8731d963e8ae9ca2', 'request_id': 'req-36bdd75c-9028-41b4-8a99-9c91b4611110'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:30.022434 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3af5ba9b9ea4a0a8731d963e8ae9ca2', 'request_id': 'req-36bdd75c-9028-41b4-8a99-9c91b4611110'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:30.029595 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3af5ba9b9ea4a0a8731d963e8ae9ca2', 'request_id': 'req-36bdd75c-9028-41b4-8a99-9c91b4611110'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:30.034176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:30.041824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] The token cache is being invalidate because project c3af5ba9b9ea4a0a8731d963e8ae9ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:30.042151 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:30.043073 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-36bdd75c-9028-41b4-8a99-9c91b4611110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:30.044749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1399/2796] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:29 2022] DELETE /identity/v3/projects/c3af5ba9b9ea4a0a8731d963e8ae9ca2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:30.049601 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.049962 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.050262 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.069673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:30.070901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:30.130253 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1398/2797] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:30.138254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.138542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.138851 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.159416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:30.160627 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:30.169135 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1400/2798] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:30.174449 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.184474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07320ccf-1ff5-418b-896e-b4a48232f776 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.189351 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.189898 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.190184 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.190461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.191145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:30.191454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.193064 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.204662 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1399/2799] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:30.209647 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.218795 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d788283-e6f3-46b3-9c7a-0be844689858 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.223467 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.224622 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.224903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.225176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.225809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.227784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.255599 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1401/2800] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:30 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:13:30.259728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.270122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb60b4-10ea-423d-8966-0e6447dd0d09 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.327292 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.327879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.328160 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.328431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.329070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.331013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.351652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1400/2801] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:30 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:30.355910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.366175 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346e3d2-d10c-4f3e-8cfc-a37714160b42 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.370834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.371429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.371713 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.371990 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.372629 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.374216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.384728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1402/2802] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:30.388526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.399266 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555271d-b47d-4734-b682-8466b0a5defb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.403845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.404445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.404726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.405000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.405642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.407261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f30b1-3292-4509-a8e7-81ad1079f0ce admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.541565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1401/2803] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:30.546353 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.558480 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62802d0-6001-40a9-a9d9-1e097e26a9ce admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.565028 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.565850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.566241 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.566594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] PATH_INFO: `/v3/projects/e10e76f7bf0f468d8eb4dc71ad99ad55/users/ac0237cdbce94515af287c7ee1c16c46/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.582242 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10e76f7bf0f468d8eb4dc71ad99ad55, user_id=ac0237cdbce94515af287c7ee1c16c46, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.585158 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.605438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1403/2804] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:30 2022] PUT /identity/v3/projects/e10e76f7bf0f468d8eb4dc71ad99ad55/users/ac0237cdbce94515af287c7ee1c16c46/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:30.606004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.606004 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.606211 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.625479 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:30.626838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:30.667764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:30.687468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1402/2805] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:30.697564 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:30.699227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:30.758490 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1095dbd-4bf9-4d10-ae53-74158bb4b5a2 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:30.762279 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:30.762914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:30.763196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:30.763463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:30.772998 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:30.774427 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a2c5-1058-492c-9b4d-07b9671ae497 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:30.783948 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1404/2806] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:34.430585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:34.432454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:34.445303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0234cc5-cdcc-4d9c-a3f7-9152b7b23c01 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:34.452122 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:34.452791 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:34.453077 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:34.453352 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] PATH_INFO: `/v3/users/9fd20e0acdd54d7493e5e657cf1c8d7e` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:34.454612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd20e0acdd54d7493e5e657cf1c8d7e)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:34.456827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:34.539401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd20e0acdd54d7493e5e657cf1c8d7e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:34.556909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd20e0acdd54d7493e5e657cf1c8d7e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:34.557710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd20e0acdd54d7493e5e657cf1c8d7e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:34.558336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd20e0acdd54d7493e5e657cf1c8d7e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:34.566854 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd20e0acdd54d7493e5e657cf1c8d7e'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:34.593737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1403/2807] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:34 2022] DELETE /identity/v3/users/9fd20e0acdd54d7493e5e657cf1c8d7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:34.599034 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32265b-bb8e-456e-9993-6c49a27d3fb0 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:34.599975 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32265b-bb8e-456e-9993-6c49a27d3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:34.600473 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32265b-bb8e-456e-9993-6c49a27d3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:34.621997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0a32265b-bb8e-456e-9993-6c49a27d3fb0 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:34.623572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0a32265b-bb8e-456e-9993-6c49a27d3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:34.711585 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1405/2808] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:34.725709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:34.729145 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:34.861808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455e77-8c45-4bdd-a57b-323f4eddd3a8 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:34.866180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:34.866845 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:34.867133 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:34.867415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:34.878365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:34.880933 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:34.898570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1404/2809] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:35.066680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.067498 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.067997 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.117612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] MFA Rules not processed for user `ac0237cdbce94515af287c7ee1c16c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:35.121455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.179632 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:35.289187 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1406/2810] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:35.294421 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.295911 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.311724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8cf8f-a322-48a8-b4ce-09f664b225da service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.325123 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.326125 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.326991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.326991 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.327600 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.329990 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.378306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.380457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.390837 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1405/2811] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:35.392475 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.404550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85e1c-a62d-442a-86da-ce6912d5be26 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.448511 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:35.471702 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f171-105a-4d67-9bf9-fca54f80ba2f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.476273 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.476471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.476917 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.477047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.477201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.477377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.477510 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] PATH_INFO: `/v3/projects/6cec6aea75ed412eb222cd5d810b86a3` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.477623 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.478204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.478598 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cec6aea75ed412eb222cd5d810b86a3)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.480180 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.480516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.503015 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1406/2812] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:35 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:35.507713 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.518617 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabbe5a-a4f3-4844-beb5-452e495cba8e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.529026 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cec6aea75ed412eb222cd5d810b86a3', 'request_id': 'req-e0e829cc-576b-4cdc-a059-ea11d3f58676'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.540002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cec6aea75ed412eb222cd5d810b86a3', 'request_id': 'req-e0e829cc-576b-4cdc-a059-ea11d3f58676'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.548741 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cec6aea75ed412eb222cd5d810b86a3', 'request_id': 'req-e0e829cc-576b-4cdc-a059-ea11d3f58676'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.560625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] The token cache is being invalidate because project 6cec6aea75ed412eb222cd5d810b86a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:35.561059 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.562102 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.563962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1407/2813] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:35 2022] DELETE /identity/v3/projects/6cec6aea75ed412eb222cd5d810b86a3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:35.568677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.570090 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.579263 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.579883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.580196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.580470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.581117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.583438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.594413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1407/2814] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:35.598594 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.600936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.615970 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ad2e2-4a06-43d4-8362-2ecff21c9dad admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.620802 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.621466 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.621746 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.622019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] PATH_INFO: `/v3/projects/e08aec8adfca462087ee37d275b0f3be/users/c95f02c0c71b4330bb836bf3efc16a16/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.634907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:35.639018 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08aec8adfca462087ee37d275b0f3be, user_id=c95f02c0c71b4330bb836bf3efc16a16, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.641740 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.642323 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e829cc-576b-4cdc-a059-ea11d3f58676 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.649637 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.650341 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.650567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.650863 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] PATH_INFO: `/v3/users/a72b90646ac24402b3a1f1983645fa4f` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.652009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72b90646ac24402b3a1f1983645fa4f)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.653916 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.655445 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1408/2815] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:35 2022] PUT /identity/v3/projects/e08aec8adfca462087ee37d275b0f3be/users/c95f02c0c71b4330bb836bf3efc16a16/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:35.659269 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.706476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72b90646ac24402b3a1f1983645fa4f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.716506 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72b90646ac24402b3a1f1983645fa4f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.717211 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72b90646ac24402b3a1f1983645fa4f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.717899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72b90646ac24402b3a1f1983645fa4f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.725748 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72b90646ac24402b3a1f1983645fa4f'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:35.728434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87624e7-c0ad-4676-b55e-18a324bb29d8 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.733608 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.734221 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.734505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.734814 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.735463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.737063 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.743749 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1408/2816] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:35 2022] DELETE /identity/v3/users/a72b90646ac24402b3a1f1983645fa4f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:35.747899 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1409/2817] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:13:35.751895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:35.753545 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:35.826522 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78721ff-d5ce-4824-b84f-f3bd4a6c099a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:35.836049 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:35.836625 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:35.836911 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:35.837205 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] PATH_INFO: `/v3/projects/e08aec8adfca462087ee37d275b0f3be/users/c95f02c0c71b4330bb836bf3efc16a16/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:35.839148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08aec8adfca462087ee37d275b0f3be, user_id=c95f02c0c71b4330bb836bf3efc16a16, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:35.841869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e125-943d-49de-8390-7066da976e84 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:35.854910 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1409/2818] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:35 2022] PUT /identity/v3/projects/e08aec8adfca462087ee37d275b0f3be/users/c95f02c0c71b4330bb836bf3efc16a16/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:36.119588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.121686 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:36.142903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65e9fb-dd97-4dea-8e0d-bbd63229c039 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.180298 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:36.225681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.226821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.227318 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.227827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] PATH_INFO: `/v3/projects/373314c69a4e40c8ac95d5806d152396` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.231107 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373314c69a4e40c8ac95d5806d152396)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.235028 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.331864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373314c69a4e40c8ac95d5806d152396', 'request_id': 'req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:36.343132 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373314c69a4e40c8ac95d5806d152396', 'request_id': 'req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:36.353554 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373314c69a4e40c8ac95d5806d152396', 'request_id': 'req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:36.367723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] The token cache is being invalidate because project 373314c69a4e40c8ac95d5806d152396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:36.367723 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:36.368546 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-81649a70-d8e0-4481-ab0b-9ff9cdbe2684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:36.370577 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1410/2819] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:36 2022] DELETE /identity/v3/projects/373314c69a4e40c8ac95d5806d152396 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:36.376999 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.377874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.378302 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.419747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:36.421410 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:36.499404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1410/2820] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:36.507389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.507924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.507924 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.529256 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:36.530533 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:36.545201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.545863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1411/2821] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:36.557027 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466e092-c197-4667-8bba-f2f7e3e0152b None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.563841 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.564607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.564991 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.565359 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.566108 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:36.566516 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.568489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.571443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:36.587088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.591791 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1411/2822] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:36.597360 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9c5e-fa18-43ea-884b-8318e7dfe727 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.604336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.605097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.605476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.606037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.606822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.608874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.650502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1412/2823] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:36 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:36.665024 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.679774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749fc07-f2ff-4233-8a2a-b8b868371229 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.792265 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.793194 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.793492 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.793736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.794942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.796918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.827066 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1412/2824] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:36 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:36.831222 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.842964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca1a2f-5629-4782-bf4d-9e9ea3e1a10e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.849587 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.850193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.850585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.850952 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.851609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.853204 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.867614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1413/2825] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:36.868890 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.880001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861fb5-5a8a-469b-91b4-97c9833fa86b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.885037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.885707 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.886086 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.886429 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.887164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.888835 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e416dc-967a-4a20-9bf5-9a60ecea4313 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.900931 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1413/2826] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:36.905790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:36.916647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b300-e8fe-4f6d-b3d4-2f91234083e2 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:36.922389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:36.922566 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.922968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.923315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] PATH_INFO: `/v3/projects/1dfdc884866e47d39376afeea03e35e5/users/de544583e031462baa428037ad5c10e3/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:36.940377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfdc884866e47d39376afeea03e35e5, user_id=de544583e031462baa428037ad5c10e3, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:36.943707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:36.965614 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1414/2827] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:36 2022] PUT /identity/v3/projects/1dfdc884866e47d39376afeea03e35e5/users/de544583e031462baa428037ad5c10e3/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:36.969051 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:36.969696 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:36.970047 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.010786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] MFA Rules not processed for user `de544583e031462baa428037ad5c10e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:37.012019 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:37.090813 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1414/2828] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:37.092631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.187619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af6528-b222-48cb-9871-5b85cd29e3ac admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.194080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.194874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.195250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.195619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.196363 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.198377 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.204715 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:37.240540 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1415/2829] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:37 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:13:37.244950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.264146 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a727-83d3-42d4-ab26-bd68351f1e14 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.342852 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.343654 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.343996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.344469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.345183 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.347739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.360918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:37.382583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1415/2830] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:37 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:37.383552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.394213 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3989e-dc66-4c5e-b365-85b22d6fc0da admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.400374 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.401685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.401685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.401685 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.402528 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.404407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.417997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1416/2831] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:13:37.422612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.435114 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465887e-bc4e-4165-8323-928e457b7064 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.440380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.441148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.441557 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.442877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] PATH_INFO: `/v3/projects/16200d359b5f4263a90be64919a1e65c/users/87c3ec672fbc4c17b69fdf3cd8c23459/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.463858 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=16200d359b5f4263a90be64919a1e65c, user_id=87c3ec672fbc4c17b69fdf3cd8c23459, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.466213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.487224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1416/2832] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:37 2022] PUT /identity/v3/projects/16200d359b5f4263a90be64919a1e65c/users/87c3ec672fbc4c17b69fdf3cd8c23459/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:37.491680 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.501936 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d12886-f242-4886-a971-70286301a3fd admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.569699 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.570358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.571023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.571023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.571844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.573602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eb32b-df7d-4c40-a31a-5298a86e9099 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.585042 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1417/2833] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 17:13:37.588979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.600834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00042ad4-fb93-4b6b-9d31-49df9d7613ae admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.606403 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.607299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.607596 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.607971 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] PATH_INFO: `/v3/projects/16200d359b5f4263a90be64919a1e65c/users/87c3ec672fbc4c17b69fdf3cd8c23459/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.610552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16200d359b5f4263a90be64919a1e65c, user_id=87c3ec672fbc4c17b69fdf3cd8c23459, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.612788 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.637822 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1417/2834] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:37 2022] PUT /identity/v3/projects/16200d359b5f4263a90be64919a1e65c/users/87c3ec672fbc4c17b69fdf3cd8c23459/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:37.640482 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.640941 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.641407 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.691788 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] MFA Rules not processed for user `87c3ec672fbc4c17b69fdf3cd8c23459`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:37.694368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:37.799950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1418/2835] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:37.814844 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:37.816802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:37.892274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b581e1-09f1-43d8-9be5-5a7939faa552 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:37.896942 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:37.897680 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:37.897932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:37.898294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:37.909962 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:37.912463 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf98114-50ea-43e4-9407-a1f7f54b6815 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:37.924421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1418/2836] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:38.394394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:38.485880 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:38.495336 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67357f0f-502d-4f90-bd50-17fb142f4335 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:38.502474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:38.503357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:38.508780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:38.509250 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] PATH_INFO: `/v3/users/de544583e031462baa428037ad5c10e3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:38.511490 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de544583e031462baa428037ad5c10e3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:38.513571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:38.610258 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de544583e031462baa428037ad5c10e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:38.624289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de544583e031462baa428037ad5c10e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:38.625011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de544583e031462baa428037ad5c10e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:38.625654 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de544583e031462baa428037ad5c10e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:38.636652 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de544583e031462baa428037ad5c10e3'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:38.693764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1419/2837] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:38 2022] DELETE /identity/v3/users/de544583e031462baa428037ad5c10e3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:38.695600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:38.695958 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:38.697894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:38.730125 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:38.731484 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:38.893092 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1419/2838] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:38.905308 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:38.907267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:39.028088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbab6-224f-4b30-b2ae-e3dcfa8109d9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:39.035208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:39.036779 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:39.037147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:39.038199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:39.049927 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:39.052372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:39.068677 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1420/2839] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:40.082440 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:40.084987 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:40.118171 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac92f8-defb-4cf7-b0d6-932def02c116 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:40.129214 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:40.130476 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:40.131396 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:40.138253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] PATH_INFO: `/v3/projects/1dfdc884866e47d39376afeea03e35e5` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:40.138253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfdc884866e47d39376afeea03e35e5)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:40.138253 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:40.308950 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfdc884866e47d39376afeea03e35e5', 'request_id': 'req-261c5edd-4b58-47f7-80fd-0dd1cd3be582'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.320226 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfdc884866e47d39376afeea03e35e5', 'request_id': 'req-261c5edd-4b58-47f7-80fd-0dd1cd3be582'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.322850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:40.337008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfdc884866e47d39376afeea03e35e5', 'request_id': 'req-261c5edd-4b58-47f7-80fd-0dd1cd3be582'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.373213 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] The token cache is being invalidate because project 1dfdc884866e47d39376afeea03e35e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:40.373953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.375234 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.377711 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1420/2840] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:40 2022] DELETE /identity/v3/projects/1dfdc884866e47d39376afeea03e35e5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:40.383919 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:40.424043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cbd-0603-4fec-b174-5614430d05e1 service neutron] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:40.583846 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:40.584627 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:40.585096 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:40.585276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] PATH_INFO: `/v3/users/87c3ec672fbc4c17b69fdf3cd8c23459` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:40.589095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c3ec672fbc4c17b69fdf3cd8c23459)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:40.593277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:40.694879 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:40.743754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c3ec672fbc4c17b69fdf3cd8c23459'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.757465 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c3ec672fbc4c17b69fdf3cd8c23459'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.758737 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c3ec672fbc4c17b69fdf3cd8c23459'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.759461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c3ec672fbc4c17b69fdf3cd8c23459'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.782500 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-78727689-cde0-4257-b2a3-6cbd09eb8664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c3ec672fbc4c17b69fdf3cd8c23459'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:40.820615 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1421/2841] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:40 2022] DELETE /identity/v3/users/87c3ec672fbc4c17b69fdf3cd8c23459 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:41.256333 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.258332 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.273966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5edd-4b58-47f7-80fd-0dd1cd3be582 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.366362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.367144 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.367610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.368110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] PATH_INFO: `/v3/projects/16200d359b5f4263a90be64919a1e65c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.369602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16200d359b5f4263a90be64919a1e65c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.371732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.438535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16200d359b5f4263a90be64919a1e65c', 'request_id': 'req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:41.453893 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16200d359b5f4263a90be64919a1e65c', 'request_id': 'req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:41.466556 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16200d359b5f4263a90be64919a1e65c', 'request_id': 'req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:41.479469 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] The token cache is being invalidate because project 16200d359b5f4263a90be64919a1e65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:41.479877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:41.480608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-1c4bcd07-d7e6-47b3-a439-7e86e39b7739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:41.487795 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf55d-d640-499a-8188-18cf3744ef17 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.488871 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf55d-d640-499a-8188-18cf3744ef17 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.489034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf55d-d640-499a-8188-18cf3744ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.491830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1421/2842] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:41 2022] DELETE /identity/v3/projects/16200d359b5f4263a90be64919a1e65c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:41.497030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.497193 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.497395 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.511585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-185bf55d-d640-499a-8188-18cf3744ef17 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:41.512950 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-185bf55d-d640-499a-8188-18cf3744ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.534154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] MFA Rules not processed for user `c95f02c0c71b4330bb836bf3efc16a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:41.536181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.583431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1422/2843] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:41.591468 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.591865 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.592143 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.607592 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:41.614306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1422/2844] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:41.622552 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:41.624109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.626590 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.628314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.633348 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1423/2845] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:41.637470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.648413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee05765-7ff0-4b70-9d11-676e6aed2801 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.654007 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.654743 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.655104 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.655454 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.656185 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:41.656571 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.658347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.676625 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1424/2846] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:13:41.677640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.687849 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb88b0-f84a-4fee-8f17-739e6749a384 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.693440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.694137 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.694495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.694875 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.695619 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.697599 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.708608 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ed731-4351-484d-b278-cd517b8499d5 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.712570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.713447 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.713567 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.713840 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.715924 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.751492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1425/2847] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:41.756494 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.797631 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.800525 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.814386 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1423/2848] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:13:41.840065 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:41.850856 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de411f-e7cf-4361-8c68-0554a34a5c7e admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.856495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.856495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.856495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.856495 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.856869 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.857469 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.883872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1426/2849] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:41.887979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.907233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7a61-84f5-4d47-b8fa-8286e8a924ca service glance] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.912786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.913499 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.913823 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.914104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.914774 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.916391 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d3b4c-be7e-418c-a84d-7629e896c2f9 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.927017 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1424/2850] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:41.931069 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.946904 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c5d-5fd9-4f7b-9291-2a8f76abd10f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.951820 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.952303 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.952585 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.952959 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.953621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:41.955332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:41.959489 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.959778 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.960057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:41.966754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1427/2851] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:41.970815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:41.981747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:41.983060 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:41.983636 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c1f0-b8e6-41c2-9754-74d5f926db13 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:41.988642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:41.990128 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:41.990415 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:41.990718 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] PATH_INFO: `/v3/projects/3b3570b4289944b690fcb745241c3120/users/3829fc3eb7524831a5c6a6d0f94c19ae/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:42.006368 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3570b4289944b690fcb745241c3120, user_id=3829fc3eb7524831a5c6a6d0f94c19ae, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:42.009059 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae69b-f396-4e65-9272-40b4ea5ce187 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:42.027517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1428/2852] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:41 2022] PUT /identity/v3/projects/3b3570b4289944b690fcb745241c3120/users/3829fc3eb7524831a5c6a6d0f94c19ae/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:42.041819 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:42.042396 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:42.042780 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:42.054082 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1425/2853] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:42.066269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:42.068792 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:42.079098 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] MFA Rules not processed for user `3829fc3eb7524831a5c6a6d0f94c19ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:42.080315 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:42.119894 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=100 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:42.144209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85bf68-1910-4cc2-acad-a982babb6400 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:42.147538 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1429/2854] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:42.159602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:42.161232 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:42.216830 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:42.217456 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:42.217737 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:42.218012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:42.220848 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4de1c-240e-49d4-a94f-dd49c439dde6 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:42.224920 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:42.225535 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:42.225821 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:42.226109 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:42.234765 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:42.236274 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:42.247499 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1430/2855] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:13:42.280607 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:42.282228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8031-cf94-4dbc-b0ca-88003aca5dea service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:42.291772 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1426/2856] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 17:13:46.954085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:46.955588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:47.027276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:47.039709 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66466-2738-45af-a8fd-ea25d1ea9e9d service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:47.043498 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:47.044117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:47.044401 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:47.044678 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:47.047807 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:47.058481 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:47.060159 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67845a7d-4ffd-4790-b03d-4a34b0c48818 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:47.070539 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1431/2857] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:52.288610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=59 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:52.331923 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:52.332246 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:52.332661 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:52.352776 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] MFA Rules not processed for user `ac0237cdbce94515af287c7ee1c16c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:52.354154 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:52.417722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1427/2858] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:54.308441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:54.308982 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:54.309115 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:54.329026 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:54.330244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:54.338006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1432/2859] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 22 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:54.351129 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:54.363404 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea33b6-c1fc-4fea-9cd7-a58e1fe84b13 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:54.369439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:54.369439 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:54.369668 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:54.369953 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:54.380612 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:54.382384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc5b05-cb76-4871-a86b-37b4d7b60b7a service swift] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:54.392030 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1428/2860] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:54.545431 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:54.677051 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c75edd-1658-41b6-beaf-05c1da7c8c56 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:54.682070 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:54.682921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:54.683207 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:54.683484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] PATH_INFO: `/v3/users/3829fc3eb7524831a5c6a6d0f94c19ae` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:54.684641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3829fc3eb7524831a5c6a6d0f94c19ae)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:54.686581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:54.762988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3829fc3eb7524831a5c6a6d0f94c19ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:54.778914 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3829fc3eb7524831a5c6a6d0f94c19ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:54.779860 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3829fc3eb7524831a5c6a6d0f94c19ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:54.780762 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3829fc3eb7524831a5c6a6d0f94c19ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:54.797591 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3829fc3eb7524831a5c6a6d0f94c19ae'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:54.837922 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1433/2861] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:13:54 2022] DELETE /identity/v3/users/3829fc3eb7524831a5c6a6d0f94c19ae => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:54.842362 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:54.842645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:54.842993 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:54.867115 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:54.868437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:54.950164 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1429/2862] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:54.965487 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:54.968720 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:55.080946 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d298-c1a1-4112-a786-79813fe89c7a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:55.086110 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:55.087038 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.087620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.088097 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.103864 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:55.105682 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d41f0d-fe2a-49d3-9b64-f308be8c4828 service neutron] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:55.124673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1434/2863] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:55.590420 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:55.592519 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:55.621601 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92294f-9845-44b7-9973-a1f5b71a7520 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:55.633460 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:55.634465 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.634834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.635113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] PATH_INFO: `/v3/projects/3b3570b4289944b690fcb745241c3120` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.636546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3570b4289944b690fcb745241c3120)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:55.638621 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:55.695816 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3570b4289944b690fcb745241c3120', 'request_id': 'req-0ec04e70-533c-45d9-98b2-76b683d2713d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:55.702409 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3570b4289944b690fcb745241c3120', 'request_id': 'req-0ec04e70-533c-45d9-98b2-76b683d2713d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:55.714282 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3570b4289944b690fcb745241c3120', 'request_id': 'req-0ec04e70-533c-45d9-98b2-76b683d2713d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:55.726943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] The token cache is being invalidate because project 3b3570b4289944b690fcb745241c3120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81529) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:13:55.727278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:55.727900 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-0ec04e70-533c-45d9-98b2-76b683d2713d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:13:55.732979 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1430/2864] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:13:55 2022] DELETE /identity/v3/projects/3b3570b4289944b690fcb745241c3120 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:55.734443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.734958 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.735066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.742887 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:55.762797 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:55.764151 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:55.831844 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1435/2865] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:55.839254 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.839543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.839824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.861036 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:55.862322 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:55.870984 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1431/2866] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:13:55.875347 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:55.886784 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd747-eb7c-4801-a198-39ff8794e931 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:55.891595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:55.892270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.892618 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.892956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.895433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:13:55.895996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:55.898526 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:55.915790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1436/2867] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 17:13:55.916895 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:55.926690 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9b1c1-1a7a-4fe2-b168-faa545110940 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:55.931541 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:55.932169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:55.932452 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:55.932726 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:55.933364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:55.935311 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:55.942008 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:55.968968 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1432/2868] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:55 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:55.973590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:55.994199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d148-389f-46f1-9c2b-22206a9aec04 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.064838 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.065595 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.065948 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.066369 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.067527 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.069562 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.092476 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1437/2869] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:55 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:56.097081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.108645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2575b-9164-48b0-a7b0-504b9d1bd0e6 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.114233 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.114957 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.115306 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.115670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.116364 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.118069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.130702 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1433/2870] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:56.134568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.145884 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f1746-f0c0-457a-affd-9d42521d660a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.151186 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.151833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.152121 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.152399 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.153081 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.154722 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52dce69-b3cb-4187-872c-2443d5831947 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.170964 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1438/2871] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:56.171837 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.182307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85e75-9ee7-4b91-a2cc-04f54498e95d admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.187058 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.187777 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.188061 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.188337 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] PATH_INFO: `/v3/projects/11f1971343bb4fd0aa148eea86c7148c/users/6de8b8102ec544309457baf77aafcdfe/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.204615 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f1971343bb4fd0aa148eea86c7148c, user_id=6de8b8102ec544309457baf77aafcdfe, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.208190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.224040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1434/2872] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:56 2022] PUT /identity/v3/projects/11f1971343bb4fd0aa148eea86c7148c/users/6de8b8102ec544309457baf77aafcdfe/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:56.234195 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.234486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.234809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.275781 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] MFA Rules not processed for user `6de8b8102ec544309457baf77aafcdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:56.278378 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:56.355769 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:56.357956 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1439/2873] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:56.363664 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.434413 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0e250-7f84-4597-9308-51e07ceac707 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.439951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.441099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.441383 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.441686 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.442354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.444325 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.482756 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1435/2874] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:56 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:56.486635 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.499408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ad3f3-7053-4c19-aba2-37680244abdb None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.579862 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.581502 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.582101 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.582414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.583226 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.585394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.628649 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1440/2875] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:56 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:13:56.632421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.659583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec09c5-0236-4936-b1de-c858a10172bf admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.666692 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.667736 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.668286 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.668853 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.669779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.672004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.685260 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1436/2876] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:56.688931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.708447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b227466-6fa1-4d0c-b238-576c194b64ab admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.716443 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.717062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.717349 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.717631 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.718289 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.719932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9a74-dcd8-47e7-ab7e-98d40ec7f383 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.746080 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1441/2877] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:56.747192 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:56.758186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587110-0d97-479e-a9d3-3b6e5046933a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:56.763294 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:56.764190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.764594 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.764877 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] PATH_INFO: `/v3/projects/40d360054e03444b817f436a51ee6f37/users/16d05ea93610404aabe3e28996ff3b6c/roles/1197acedde154542b162281404f9b02c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.785196 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d360054e03444b817f436a51ee6f37, user_id=16d05ea93610404aabe3e28996ff3b6c, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:56.788405 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:56.808650 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1437/2878] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:56 2022] PUT /identity/v3/projects/40d360054e03444b817f436a51ee6f37/users/16d05ea93610404aabe3e28996ff3b6c/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:13:56.821358 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:56.821719 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:56.821923 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:56.853809 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] MFA Rules not processed for user `16d05ea93610404aabe3e28996ff3b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:56.855357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:56.932675 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1442/2879] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:56.937258 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.006444 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0afe0-da63-4fdf-a4c5-4d858a1ec4ea admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.011532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.012239 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.012523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.013023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] PATH_INFO: `/v3/projects` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.013671 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.015763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.022936 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:57.070699 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1438/2880] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:13:56 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 17:13:57.074189 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.086688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef9902-c10c-4a8e-a3a8-079b1754aede None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.157402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.158515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.159660 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.159932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.160612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.162674 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.176912 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:57.188892 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1443/2881] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:13:57 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:13:57.193110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.204387 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6bca3-557a-40e7-9480-6d1523d2354f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.209955 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.210635 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.210954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.211231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.211888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.213518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.225907 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1439/2882] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:57.230193 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.244921 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68a45f-cb0b-47d0-be9e-f786d2bb08d0 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.250408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.251558 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.251906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.252277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] PATH_INFO: `/v3/projects/71148a2632544440b479e53c5fc02ab8/users/8a18099dabf24a57a21489f15ab8605c/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.274525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71148a2632544440b479e53c5fc02ab8, user_id=8a18099dabf24a57a21489f15ab8605c, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.277507 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.295568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1444/2883] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:57 2022] PUT /identity/v3/projects/71148a2632544440b479e53c5fc02ab8/users/8a18099dabf24a57a21489f15ab8605c/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:57.300223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.310786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547f34-b9e5-4233-980e-f9e22af90c27 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.376904 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.377677 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.378079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.378401 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.379118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.380834 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d21812-67d3-4f7d-8e1c-4d8ea271dc35 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.391918 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1440/2884] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:13:57.396342 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.414684 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796047a-62d5-4b0b-826d-adcd9ee7d16f admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.420726 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.421493 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.422091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.422447 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] PATH_INFO: `/v3/projects/71148a2632544440b479e53c5fc02ab8/users/8a18099dabf24a57a21489f15ab8605c/roles/039ce10567a8460a9bd21a4b11653a8d` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.425300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71148a2632544440b479e53c5fc02ab8, user_id=8a18099dabf24a57a21489f15ab8605c, role_id=039ce10567a8460a9bd21a4b11653a8d)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.428117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.450763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1445/2885] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:13:57 2022] PUT /identity/v3/projects/71148a2632544440b479e53c5fc02ab8/users/8a18099dabf24a57a21489f15ab8605c/roles/039ce10567a8460a9bd21a4b11653a8d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:13:57.456706 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.457070 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.457416 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.490249 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] MFA Rules not processed for user `8a18099dabf24a57a21489f15ab8605c`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:13:57.491739 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:57.570346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1441/2886] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:13:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:13:57.581938 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:57.583790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:57.651032 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1f44-2674-4263-95e7-0d26cd98ed98 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:57.654800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:57.655420 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:57.655700 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:57.655972 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:57.723066 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:57.724517 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:57.734863 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1446/2887] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:13:59.446732 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:13:59.448186 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:13:59.461593 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af041c-f3e9-4d3c-83e2-7c5a2b157146 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:13:59.465220 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:13:59.465838 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:13:59.466121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:13:59.466398 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:13:59.531760 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:59.535188 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:13:59.537081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:13:59.547297 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1442/2888] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:13:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:00.169333 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:00.179261 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094280-75f3-4e4d-9df3-798f614de28f service cinder] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:00.183089 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:00.183815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:00.184117 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:00.184394 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:00.204642 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:00.206434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc2266-43a3-4d66-b04c-48825f899f12 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:00.220177 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1447/2889] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:04.272996 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:04.334056 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cdad-7961-474f-9cd0-3558e4f1dc41 service cinder] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:04.338623 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:04.339274 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:04.339554 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:04.339824 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] PATH_INFO: `/v3/users/6de8b8102ec544309457baf77aafcdfe` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:04.340932 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de8b8102ec544309457baf77aafcdfe)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:04.342850 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:04.391042 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de8b8102ec544309457baf77aafcdfe'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:04.398534 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de8b8102ec544309457baf77aafcdfe'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:04.399176 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de8b8102ec544309457baf77aafcdfe'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:04.399779 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de8b8102ec544309457baf77aafcdfe'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:04.406898 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de8b8102ec544309457baf77aafcdfe'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:04.424855 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1443/2890] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:14:04 2022] DELETE /identity/v3/users/6de8b8102ec544309457baf77aafcdfe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:04.429473 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:04.429999 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:04.430106 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:04.448764 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:04.449951 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:04.500801 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:04.510175 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1448/2891] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:04.520424 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:04.521826 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:04.578570 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ec212-921b-4fa7-82f1-72cd942d7da1 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:04.582926 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:04.583524 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:04.583807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:04.584079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:04.592930 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:04.594345 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:04.604292 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1444/2892] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:14:05.022596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:05.024741 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:05.037932 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a469-fa5e-48b6-83a4-528692a98b5f None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:05.060645 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:05.061945 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:05.062398 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:05.063008 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] PATH_INFO: `/v3/projects/11f1971343bb4fd0aa148eea86c7148c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:05.065977 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f1971343bb4fd0aa148eea86c7148c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:05.068505 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:05.125833 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f1971343bb4fd0aa148eea86c7148c', 'request_id': 'req-354d9b19-46bf-4a2f-92ff-7c53710f79c6'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.132766 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f1971343bb4fd0aa148eea86c7148c', 'request_id': 'req-354d9b19-46bf-4a2f-92ff-7c53710f79c6'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.140808 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f1971343bb4fd0aa148eea86c7148c', 'request_id': 'req-354d9b19-46bf-4a2f-92ff-7c53710f79c6'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.152440 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] The token cache is being invalidate because project 11f1971343bb4fd0aa148eea86c7148c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:14:05.152731 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.153365 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.154997 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1449/2893] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:14:05 2022] DELETE /identity/v3/projects/11f1971343bb4fd0aa148eea86c7148c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:05.160104 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:05.170004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afdfe8-2fe4-40f8-937c-4a4c735b4b6f service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:05.185140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:05.232886 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:05.233523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:05.233806 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:05.234081 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] PATH_INFO: `/v3/users/16d05ea93610404aabe3e28996ff3b6c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:05.235224 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d05ea93610404aabe3e28996ff3b6c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:05.237181 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:05.287227 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d05ea93610404aabe3e28996ff3b6c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.296012 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d05ea93610404aabe3e28996ff3b6c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.297268 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d05ea93610404aabe3e28996ff3b6c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.297899 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d05ea93610404aabe3e28996ff3b6c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.305798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d05ea93610404aabe3e28996ff3b6c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.323883 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1445/2894] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:14:05 2022] DELETE /identity/v3/users/16d05ea93610404aabe3e28996ff3b6c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:05.602551 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:05.604111 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:05.619206 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d9b19-46bf-4a2f-92ff-7c53710f79c6 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:05.677406 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:05.678037 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:05.678319 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:05.678589 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] PATH_INFO: `/v3/projects/40d360054e03444b817f436a51ee6f37` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:05.679714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d360054e03444b817f436a51ee6f37)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:05.681596 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:05.729011 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d360054e03444b817f436a51ee6f37', 'request_id': 'req-2acf5b58-ba39-455b-af7e-e22c312928d1'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.735000 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d360054e03444b817f436a51ee6f37', 'request_id': 'req-2acf5b58-ba39-455b-af7e-e22c312928d1'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.742492 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d360054e03444b817f436a51ee6f37', 'request_id': 'req-2acf5b58-ba39-455b-af7e-e22c312928d1'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.753778 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] The token cache is being invalidate because project 40d360054e03444b817f436a51ee6f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:14:05.754223 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.754903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.756408 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1450/2895] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:14:05 2022] DELETE /identity/v3/projects/40d360054e03444b817f436a51ee6f37 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:05.760527 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:05.761966 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:05.775173 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128b346-e36a-452a-bb23-a8c48e1a3ace admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:05.839821 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:05.840513 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:05.840861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:05.841139 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] PATH_INFO: `/v3/users/8a18099dabf24a57a21489f15ab8605c` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:05.842263 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a18099dabf24a57a21489f15ab8605c)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:05.844228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:05.886346 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:05.894861 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a18099dabf24a57a21489f15ab8605c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.903223 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a18099dabf24a57a21489f15ab8605c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.903845 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a18099dabf24a57a21489f15ab8605c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.904457 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a18099dabf24a57a21489f15ab8605c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.911982 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-ef7924ba-15e1-4f2d-8a88-6dfdf0e7c5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a18099dabf24a57a21489f15ab8605c'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:05.931190 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1446/2896] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:14:05 2022] DELETE /identity/v3/users/8a18099dabf24a57a21489f15ab8605c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:06.202163 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.203825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:06.219244 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b58-ba39-455b-af7e-e22c312928d1 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.229062 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:06.279372 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.279996 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.280277 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.280542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] PATH_INFO: `/v3/projects/71148a2632544440b479e53c5fc02ab8` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.281643 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=71148a2632544440b479e53c5fc02ab8)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.284146 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.331947 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71148a2632544440b479e53c5fc02ab8', 'request_id': 'req-27422e44-4324-4adb-ab78-503eb5c16ffe'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:06.338290 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71148a2632544440b479e53c5fc02ab8', 'request_id': 'req-27422e44-4324-4adb-ab78-503eb5c16ffe'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:06.346738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71148a2632544440b479e53c5fc02ab8', 'request_id': 'req-27422e44-4324-4adb-ab78-503eb5c16ffe'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:06.362857 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] The token cache is being invalidate because project 71148a2632544440b479e53c5fc02ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:14:06.363248 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:06.363989 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-27422e44-4324-4adb-ab78-503eb5c16ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:06.365901 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1451/2897] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:14:06 2022] DELETE /identity/v3/projects/71148a2632544440b479e53c5fc02ab8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:06.371029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.371546 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.371645 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.392250 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:06.393458 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:06.454763 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1447/2898] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 17:14:06.464142 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.464433 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.464710 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.485131 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:06.487012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:06.494909 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1452/2899] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:06.499218 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.509354 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f596f1-d029-4a86-a1a9-b05ca6131a9e None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.513921 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.514547 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.514864 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.515140 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.515786 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:14:06.516093 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.517722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.529032 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1448/2900] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:14:06.533736 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.542822 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4165225-53f1-4bde-9871-fa53e53aa9fd None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.547461 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.548050 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.548357 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.549196 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.549917 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.551826 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.578021 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1453/2901] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:14:06 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:14:06.582330 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.592303 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3b145-d4fa-4464-bf55-2f72d7a7345b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.648517 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.649118 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.649400 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.649675 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.650298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.652288 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.674380 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1449/2902] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:14:06 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:14:06.678593 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.689659 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ccf2d-e5e3-42f0-8016-8b3ac7b70441 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.694282 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.694913 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.695198 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.695474 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.696120 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.697728 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.707998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1454/2903] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:14:06.711812 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.721981 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f201f8d-8057-436f-866e-3b1b38757d30 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.726767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.727365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.727672 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.727943 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.728577 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.730153 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a689ac-5b73-4d1c-878d-7902c0df32f8 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.741309 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1450/2904] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:14:06.745386 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.756013 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd82d-b5cf-41b8-84b2-4bb23eb971c9 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:06.760542 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:06.761183 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.761463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.761734 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] PATH_INFO: `/v3/projects/df371c116bd14e7c9998076931d50cb3/users/641813986add421a80b990a1fbbf7a3d/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.776456 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=df371c116bd14e7c9998076931d50cb3, user_id=641813986add421a80b990a1fbbf7a3d, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:06.779138 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:06.793504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1455/2905] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:14:06 2022] PUT /identity/v3/projects/df371c116bd14e7c9998076931d50cb3/users/641813986add421a80b990a1fbbf7a3d/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:14:06.804523 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:06.804809 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:06.805084 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:06.833385 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] MFA Rules not processed for user `641813986add421a80b990a1fbbf7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:06.834586 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:06.845163 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:06.934482 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1451/2906] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:06.949270 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:06.951200 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:06.994949 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:07.010641 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41787e01-e27c-47cf-8499-a9db3949f4ff admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:07.014216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '997ef7cf46b345d0ab4085d3419cac44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:07.014851 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:07.015130 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:07.015403 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:07.023812 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:07.025228 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423fe35-16b3-47db-9a75-5564c21bd3d2 service cinder] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:07.034705 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1456/2907] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:09.586455 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:09.648790 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46e01-9ab9-4047-b9f5-29679ac3e7b4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:09.653358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:09.653985 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:09.654269 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:09.654544 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] PATH_INFO: `/v3/users/641813986add421a80b990a1fbbf7a3d` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:09.656057 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] RBAC: Authorizing `identity:delete_user(user_id=641813986add421a80b990a1fbbf7a3d)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:09.658121 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:09.703676 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641813986add421a80b990a1fbbf7a3d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:09.711148 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641813986add421a80b990a1fbbf7a3d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:09.711767 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641813986add421a80b990a1fbbf7a3d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:09.712356 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641813986add421a80b990a1fbbf7a3d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:09.719256 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641813986add421a80b990a1fbbf7a3d'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:09.736903 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1452/2908] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:14:09 2022] DELETE /identity/v3/users/641813986add421a80b990a1fbbf7a3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:09.742023 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:09.742504 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:09.742621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:09.762486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:09.763697 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:09.823212 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1457/2909] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:09.833992 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:09.835417 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:09.872113 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:09.898633 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671516a-086d-4830-a31f-c0db70cf468b admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:09.902550 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:09.903271 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:09.903560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:09.903839 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:09.914319 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:09.915810 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5d833-1c90-42e4-b198-ee7176375d65 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:09.926365 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1453/2910] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:14:10.254621 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.256147 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:10.337429 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf13fac-2983-4224-8f46-8173ba8ba4f4 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.342047 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.342695 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.342979 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.343254 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] PATH_INFO: `/v3/projects/df371c116bd14e7c9998076931d50cb3` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.344364 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df371c116bd14e7c9998076931d50cb3)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.346829 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.395931 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df371c116bd14e7c9998076931d50cb3', 'request_id': 'req-63b668f8-84df-4495-9307-172de4873ecc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:10.403435 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df371c116bd14e7c9998076931d50cb3', 'request_id': 'req-63b668f8-84df-4495-9307-172de4873ecc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:10.412216 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df371c116bd14e7c9998076931d50cb3', 'request_id': 'req-63b668f8-84df-4495-9307-172de4873ecc'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:10.423085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] The token cache is being invalidate because project df371c116bd14e7c9998076931d50cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:14:10.423733 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:10.424446 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-63b668f8-84df-4495-9307-172de4873ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:10.425998 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1458/2911] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:14:10 2022] DELETE /identity/v3/projects/df371c116bd14e7c9998076931d50cb3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:10.430915 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.431201 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.431502 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.495119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:10.496352 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:10.557719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1454/2912] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:10.565763 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.566325 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.566698 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.575590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:10.588470 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:10.589604 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:10.598640 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1459/2913] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:10.602901 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.612818 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec731-696f-48ea-8ce6-eaea52872f64 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.617407 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.618029 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.618296 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.618569 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] PATH_INFO: `/v3/domains` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.619262 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81529) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 17:14:10.619572 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.621169 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.636450 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1455/2914] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 22 17:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 17:14:10.637612 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.647602 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b7d53-a37f-46eb-ad68-74c1cbfa5dba None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.652307 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.652903 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.653187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.653460 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.654087 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.656434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.686681 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1460/2915] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 22 17:14:10 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:14:10.691216 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.701384 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c23b23-36c6-4d67-8799-9857617eb62a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.760559 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.761799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.762149 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.762642 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] PATH_INFO: `/v3/users` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.763363 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.765284 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.793335 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1456/2916] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 22 17:14:10 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 17:14:10.794525 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.806580 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34707-0b3e-48a6-a5a6-63f623a58a8b admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.811735 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.812524 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.812827 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.813079 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] PATH_INFO: `/v3/roles` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.814486 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.816276 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.826926 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1461/2917] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:14:10.831324 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.841951 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9df48-5713-408e-944d-206018263d8a admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.846980 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.847652 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.847935 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.848209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.848856 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.850443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244357c-d7f8-4ef8-ab02-3d93fffa0806 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.861634 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1457/2918] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 22 17:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 17:14:10.865872 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:10.879344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47334521-ae8f-4900-8ef2-3fde15a1696a admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:10.884815 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:10.885463 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:10.885753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:10.886085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] PATH_INFO: `/v3/projects/68cc5dad9e3d417fbb0a9f0f3ec52a8c/users/d2b1b4a95726493f8a22b7b0dc2c6c84/roles/1197acedde154542b162281404f9b02c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:10.902161 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cc5dad9e3d417fbb0a9f0f3ec52a8c, user_id=d2b1b4a95726493f8a22b7b0dc2c6c84, role_id=1197acedde154542b162281404f9b02c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:10.904836 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:10.930414 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1462/2919] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 22 17:14:10 2022] PUT /identity/v3/projects/68cc5dad9e3d417fbb0a9f0f3ec52a8c/users/d2b1b4a95726493f8a22b7b0dc2c6c84/roles/1197acedde154542b162281404f9b02c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:14:11.001002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:11.002119 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:11.002605 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:11.024687 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:11.035208 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] MFA Rules not processed for user `d2b1b4a95726493f8a22b7b0dc2c6c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:11.036443 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:11.101172 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1458/2920] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:11.113840 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:11.115581 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:11.191570 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf03b46-a676-4073-a687-024f65994742 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:11.195800 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd137d89c725440d290a2d63c4c9c67f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:11.196441 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:11.196825 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:11.197114 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:11.206359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:11.207832 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:11.217356 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1463/2921] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:14.996874 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:14.998299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:15.057531 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849403e-eff5-41ce-956e-ce29c19d0ea4 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:15.061137 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:15.061751 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:15.062040 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:15.062316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:15.064101 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:15.131542 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:15.133001 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:15.142885 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1459/2922] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:16.988091 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:16.989874 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:17.123839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:17.134906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8910-24d3-48ab-9bb4-59026bd53543 service glance] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:17.146423 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bddbf2c5a23405bb4ae9c56e9b17d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:17.147129 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:17.147590 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:17.147714 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:17.149752 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:17.181803 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:17.183906 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b4418-a1f8-4984-ae73-6774f84a21cd service nova] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:17.197886 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1464/2923] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:14:25.138318 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=78 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:27.193370 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=6 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:32.781870 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:32.845247 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba33af-8d49-4755-951d-6e384b9f84a3 service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:32.849802 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:32.850437 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:32.850747 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:32.851023 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] PATH_INFO: `/v3/users/d2b1b4a95726493f8a22b7b0dc2c6c84` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:32.852126 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b1b4a95726493f8a22b7b0dc2c6c84)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:32.854037 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:32.899940 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b1b4a95726493f8a22b7b0dc2c6c84'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:32.908418 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b1b4a95726493f8a22b7b0dc2c6c84'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:32.909004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b1b4a95726493f8a22b7b0dc2c6c84'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:32.909600 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b1b4a95726493f8a22b7b0dc2c6c84'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:32.916532 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b1b4a95726493f8a22b7b0dc2c6c84'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:32.933307 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1460/2924] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:14:32 2022] DELETE /identity/v3/users/d2b1b4a95726493f8a22b7b0dc2c6c84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:32.937725 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] REQUEST_METHOD: `POST` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:32.938328 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:32.938520 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:32.957519 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.auth.core [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] MFA Rules not processed for user `6b441038ebcb444080c635316cb2b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:14:32.958748 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:33.018637 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1465/2925] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 22 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:14:33.028316 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:33.029735 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:33.108801 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207eae3-d9c7-4851-a704-c874c26ac551 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:33.113180 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ddabdd350b45c68233ea757a6aec54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:33.113797 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:33.114079 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:33.114366 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:33.123421 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:33.125109 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:33.135099 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1461/2926] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 17:14:33.403694 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:14:33.405376 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:14:33.418095 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761853e-7017-42b2-bce2-ae30cd78ef09 None None] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:14:33.423409 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:14:33.424053 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:14:33.424338 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:14:33.424609 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] PATH_INFO: `/v3/projects/68cc5dad9e3d417fbb0a9f0f3ec52a8c` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:14:33.425744 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cc5dad9e3d417fbb0a9f0f3ec52a8c)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:14:33.427704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:14:33.475707 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cc5dad9e3d417fbb0a9f0f3ec52a8c', 'request_id': 'req-cab64902-972d-423f-af35-6cc2c36229cb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:33.482242 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cc5dad9e3d417fbb0a9f0f3ec52a8c', 'request_id': 'req-cab64902-972d-423f-af35-6cc2c36229cb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:33.490413 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cc5dad9e3d417fbb0a9f0f3ec52a8c', 'request_id': 'req-cab64902-972d-423f-af35-6cc2c36229cb'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:33.501549 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] The token cache is being invalidate because project 68cc5dad9e3d417fbb0a9f0f3ec52a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:14:33.501839 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:33.502483 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:14:33.504119 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1466/2927] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:14:33 2022] DELETE /identity/v3/projects/68cc5dad9e3d417fbb0a9f0f3ec52a8c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:14:43.130857 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:43.497969 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:12.922342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:12.923881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:13.034619 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541019a6-a241-4e48-b498-5468af28495b service neutron] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:13.097004 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:13.097624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:13.097912 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:13.098189 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:13.099954 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:13.111836 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:13.113438 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:13.124881 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1462/2928] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:15:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:15:21.084434 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:21.085993 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:21.104359 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab64902-972d-423f-af35-6cc2c36229cb admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:21.109572 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:21.110187 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:21.110478 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:21.110790 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:21.112547 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:21.127497 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:21.130067 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:21.138485 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:21.139947 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:21.141753 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1467/2929] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:15:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:15:21.212358 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e174b-5006-48fc-9908-4a11c6230575 service placement] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:21.217518 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:21.218143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:21.218425 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:21.218728 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] PATH_INFO: `/v3/users/3afa03384cd84e40be3255e6d61594da` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:21.219843 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afa03384cd84e40be3255e6d61594da)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:21.221750 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:21.235159 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:21.268168 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afa03384cd84e40be3255e6d61594da'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.275376 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afa03384cd84e40be3255e6d61594da'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.276110 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afa03384cd84e40be3255e6d61594da'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.276784 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afa03384cd84e40be3255e6d61594da'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.283807 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afa03384cd84e40be3255e6d61594da'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.300815 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1463/2930] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:15:21 2022] DELETE /identity/v3/users/3afa03384cd84e40be3255e6d61594da => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:15:21.468286 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:21.480755 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa28b8-3c87-41ac-8525-f67b3a14f65b service placement] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:21.537703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:21.538402 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:21.538712 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:21.538988 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] PATH_INFO: `/v3/projects/e7cfa103295e44de9e6ab6346c80c396` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:21.540085 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cfa103295e44de9e6ab6346c80c396)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:21.541968 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:21.588425 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cfa103295e44de9e6ab6346c80c396', 'request_id': 'req-91a0b460-f10b-483b-b735-13941afefdad'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.594703 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cfa103295e44de9e6ab6346c80c396', 'request_id': 'req-91a0b460-f10b-483b-b735-13941afefdad'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.601704 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cfa103295e44de9e6ab6346c80c396', 'request_id': 'req-91a0b460-f10b-483b-b735-13941afefdad'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.612738 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] The token cache is being invalidate because project e7cfa103295e44de9e6ab6346c80c396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:15:21.613034 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.613651 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.615199 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1468/2931] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:15:21 2022] DELETE /identity/v3/projects/e7cfa103295e44de9e6ab6346c80c396 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:15:21.619143 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:21.620552 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:21.634009 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa2b3-574a-42b8-84b8-ee8af0f17fb3 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:21.689722 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:21.690299 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:21.690583 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:21.690888 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] PATH_INFO: `/v3/users/f9607b70061b403192633252ef2fe6d7` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:21.692000 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9607b70061b403192633252ef2fe6d7)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:21.693941 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:21.740869 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9607b70061b403192633252ef2fe6d7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.749314 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9607b70061b403192633252ef2fe6d7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.750167 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9607b70061b403192633252ef2fe6d7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.750798 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9607b70061b403192633252ef2fe6d7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.758225 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-b7d8f95d-7064-419a-a7ad-b9ec1d3122f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9607b70061b403192633252ef2fe6d7'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:21.775231 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1464/2932] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:15:21 2022] DELETE /identity/v3/users/f9607b70061b403192633252ef2fe6d7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:15:21.950238 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:21.951942 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:21.968918 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0b460-f10b-483b-b735-13941afefdad admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:22.034300 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:22.034981 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:22.035267 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:22.035548 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] PATH_INFO: `/v3/projects/c86db5c5866f4f729d097ac4192d8f49` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:22.036673 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86db5c5866f4f729d097ac4192d8f49)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:22.038584 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:22.060515 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:22.086344 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86db5c5866f4f729d097ac4192d8f49', 'request_id': 'req-9f99fa22-ff91-497d-997b-eb94f1c594e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:22.094620 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86db5c5866f4f729d097ac4192d8f49', 'request_id': 'req-9f99fa22-ff91-497d-997b-eb94f1c594e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:22.102025 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86db5c5866f4f729d097ac4192d8f49', 'request_id': 'req-9f99fa22-ff91-497d-997b-eb94f1c594e7'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:22.113136 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] The token cache is being invalidate because project c86db5c5866f4f729d097ac4192d8f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:15:22.113426 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:22.114061 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:22.115568 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1469/2933] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:15:21 2022] DELETE /identity/v3/projects/c86db5c5866f4f729d097ac4192d8f49 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:15:31.771730 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:32.110088 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:50.398298 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] REQUEST_METHOD: `POST` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:50.398808 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:50.398914 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:50.428486 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.auth.core [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] MFA Rules not processed for user `8bbff8baec7248ecbffe330a168cab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81529) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 17:15:50.429719 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:50.484640 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1465/2934] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 22 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 17:15:50.525002 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:50.526438 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:50.595005 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99fa22-ff91-497d-997b-eb94f1c594e7 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:50.599883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e995aeb6d440808a86ca23585ffdf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:50.600484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] REQUEST_METHOD: `GET` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:50.600768 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:50.601041 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:50.609754 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:50.611373 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:50.619578 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1470/2935] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 22 17:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 17:15:57.391963 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:57.393535 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:57.462055 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e045e4-3f5c-4891-8d19-f810847b5329 None None] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:57.466610 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:57.467278 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:57.467560 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:57.467842 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] PATH_INFO: `/v3/users/ac0237cdbce94515af287c7ee1c16c46` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:57.468974 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0237cdbce94515af287c7ee1c16c46)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:57.470927 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:57.517291 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0237cdbce94515af287c7ee1c16c46'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.524684 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0237cdbce94515af287c7ee1c16c46'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.525326 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0237cdbce94515af287c7ee1c16c46'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.526039 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0237cdbce94515af287c7ee1c16c46'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.533069 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0237cdbce94515af287c7ee1c16c46'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.550304 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1466/2936] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:15:57 2022] DELETE /identity/v3/users/ac0237cdbce94515af287c7ee1c16c46 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:15:57.724405 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:57.737076 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874900-c727-4a65-916b-8e3cad817b40 service swift] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:57.796043 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:57.796877 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:57.797247 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:57.797883 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] PATH_INFO: `/v3/projects/e10e76f7bf0f468d8eb4dc71ad99ad55` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:57.799430 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10e76f7bf0f468d8eb4dc71ad99ad55)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:57.801471 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:57.846448 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10e76f7bf0f468d8eb4dc71ad99ad55', 'request_id': 'req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.852973 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10e76f7bf0f468d8eb4dc71ad99ad55', 'request_id': 'req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.860811 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10e76f7bf0f468d8eb4dc71ad99ad55', 'request_id': 'req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.872305 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] The token cache is being invalidate because project e10e76f7bf0f468d8eb4dc71ad99ad55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:15:57.872592 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.873208 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:57.874647 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1471/2937] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:15:57 2022] DELETE /identity/v3/projects/e10e76f7bf0f468d8eb4dc71ad99ad55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:15:57.878602 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:57.880002 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:57.893584 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbece8-852e-4562-8fa9-ba648c4c6124 admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:57.905209 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:57.952053 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:57.952678 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:57.952956 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:57.953228 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] PATH_INFO: `/v3/users/c95f02c0c71b4330bb836bf3efc16a16` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:57.954339 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95f02c0c71b4330bb836bf3efc16a16)` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:57.956267 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:58.003746 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95f02c0c71b4330bb836bf3efc16a16'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.011468 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95f02c0c71b4330bb836bf3efc16a16'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.012072 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95f02c0c71b4330bb836bf3efc16a16'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.012681 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95f02c0c71b4330bb836bf3efc16a16'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.019589 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.notifications [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95f02c0c71b4330bb836bf3efc16a16'} {{(pid=81529) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.037212 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1467/2938] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 22 17:15:57 2022] DELETE /identity/v3/users/c95f02c0c71b4330bb836bf3efc16a16 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 17:15:58.210006 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Authenticating user token {{(pid=81530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:15:58.212019 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.fernet_utils [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:15:58.225805 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a18ca-b6a8-4909-91c3-a6fb2a1cf9d4 admin admin] Validating token access rules against request {{(pid=81530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:15:58.243508 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:58.284565 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b441038ebcb444080c635316cb2b19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fea30cfd8ebb4269b38aaa42ab5d2d7a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:15:58.285202 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:15:58.285484 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:15:58.285757 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] PATH_INFO: `/v3/projects/e08aec8adfca462087ee37d275b0f3be` {{(pid=81530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:15:58.287012 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08aec8adfca462087ee37d275b0f3be)` {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:15:58.288794 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] RBAC: Authorization granted {{(pid=81530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:15:58.334332 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08aec8adfca462087ee37d275b0f3be', 'request_id': 'req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.341224 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08aec8adfca462087ee37d275b0f3be', 'request_id': 'req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.347688 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08aec8adfca462087ee37d275b0f3be', 'request_id': 'req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40'} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.358301 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] The token cache is being invalidate because project e08aec8adfca462087ee37d275b0f3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 17:15:58.358588 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.359237 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG keystone.notifications [None req-43bb1a5c-de09-43ef-9c76-2d1ee4ed8f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 17:15:58.360724 dv-cinder-835384-28-smb devstack@keystone.service[81530]: [pid: 81530|app: 0|req: 1472/2939] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 22 17:15:58 2022] DELETE /identity/v3/projects/e08aec8adfca462087ee37d275b0f3be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 17:16:08.033669 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:08.355389 dv-cinder-835384-28-smb devstack@keystone.service[81530]: DEBUG dbcounter [-] [81530] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:20:27.360007 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Authenticating user token {{(pid=81529) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 17:20:27.361412 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:20:27.432799 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f86-7a1b-4ab9-ad2d-c2a18c0a565f admin admin] Validating token access rules against request {{(pid=81529) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 17:20:27.493729 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30ceabc5940d40cf8a339f17a375716c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37260af8ddaf447e929f5facaeaf0357', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81529) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 17:20:27.494342 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] REQUEST_METHOD: `GET` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 17:20:27.494624 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] SCRIPT_NAME: `/identity` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 17:20:27.494928 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81529) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 17:20:27.496670 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.fernet_utils [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81529) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 17:20:27.507710 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 17:20:27.509266 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590fc22-16c7-49a8-8d67-62e08d08d507 service placement] RBAC: Authorization granted {{(pid=81529) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 17:20:27.519543 dv-cinder-835384-28-smb devstack@keystone.service[81529]: [pid: 81529|app: 0|req: 1468/2940] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 22 17:20:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 17:20:37.514828 dv-cinder-835384-28-smb devstack@keystone.service[81529]: DEBUG dbcounter [-] [81529] Writing DB stats keystone:SELECT=58 {{(pid=81529) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}